First thing I’d do is go to the share settings in Infuse and change from “Auto” to either SMB 2 or Legacy and see if that helps. Your router may be set to SMB 3 with a ton of security overhead.
The next thing I’d try would be to swap to a new Ethernet cable. Make sure it’s a CAT5E or better too.
Then you may want to try some of the other suggestions on the link above.
I’d still try a new Ethernet cable just to eliminate that for sure. I learned the hard way that assuming that since an Ethernet cable was passing traffic it had to be good.
When you use a router as a server there may be other settings in the router that affect local traffic.
Which router (manufacturer / model) you are using? What kind of storage device do you use (HDD/SSD)?
Where do you have the storage connected?
Have you ever written a large file to the storage device from a PC and see if the same problem occurs? For me it looks like you have a problem with the USB Speed of the Router…
Please try to read/write to your WD via SMB from your computer and check which speed you get there (take a big file and copy it from your computer to the HDD and then back). So you can figure out if the problem ist the Apple TV or your LAN
So the PC also has the performance problem when accessing the hard disk via SMB.
What can also be: do I assume correctly that the connected HDD is used with NTFS as file system? I suspect your router is running a Unix derivative system. This can read and write NTFS with certain drivers, but it is extremely slow. You can test another HDD and format it with ExFat or Fat32 and then test the speed again. Attention, Fat32 only supports files with a maximum size of 4 GB per file.