A set of additional improvements in this area are available in today’s 8.5 update.
If Infuse has already scanned through your media files you can use the option to clear cached metadata and artwork in the Infuse > Settings > Metadata & Artwork menu to trigger a refresh.