Welcome to the forum!
Currently Infuse doesn’t support playing media from iCloud, it only backs up the textual metadata and settings currently.
If you’re not seeing the same settings on the ATV then you should check to see what apple id is being used for the app store and icloud. they should be the same. on all devices you want to use Infuse on.
It may take the ATV a short period of time to sync all of the settings and share info so you can go to the settings > Library screen and see what the status is.