Failure to sync library no matter what

Hey team,
So recently I tried the Infuse beta to test out the new direct mode. While it is still being worked on I am thought to go back to library mode for now.

So I sync my server. It’s moderately big. Everything syncs fine except for TV Shows. I have a total of 483934 and it will randomly crash anywhere after 120000. It will say syncing failed and TV Show library count will remain at zero.

So I try the latest public release. Same issue. Same issue on iOS, Mac OS, Apple TV, iPad apps

Looking for some guidance here on how to fix it.
Thanks!