That’s what I did too and I don’t have any issue. Lucky me
I’ve had intermittent buffering issues when streaming from a OneDrive though (although the data throughput should be more than enough) - maybe it’s the way Infuse deals with some network circumstances?
You could also test by switching the Apple TV between Ethernet and WiFi. Ethernet is usually more stable than WiFi but sometimes the opposite is true. WiFi can have intermittent throughput reduction, especially 5Ghz, or if you are in a crowded WiFi area (if you live in an appartment, you most certainly are).
Infuse and the Apple TV’s OS should handle these variations well, but maybe they don’t.
It seems that the Plex DLNA server transmits the original media so if it works well for you it’s all good!