I have noticed that Infuse will use an image artwork for a movie if it is in the same directory even if the filename is completely different.
The following page indicates that the filename should be a match though:
Is this the expected behaviour? If so, is it possible to disable local images for artwork?