I’ve successfully added custom artwork by uploading a jpg file of the same name as the videos in my home videos folder.
However, this is only reflected in the small ‘portrait’ version of the artwork. Along the top shelf of the Infuse app, the ‘landscape artwork’ version videos still display the automatically generated images.