SSH into remote ATV not working

I just hooked up my ATV at a friends house to test SSH and to see if I could add media over the internet. I noted the IP address of the ATV and went home to try and connect but Cyberduck is unable to, instead it gives me an I/O Error: Connection Failed message. Do I have to change some settings on his network? It’s windows based so I’m not familiar with network configuration.