When I first setup SBS 2003 and activated remote access, I had no trouble connecting to the server from home.
Now (two months later) I continually 'time out' trying to access the server dekstop remotely with a notice stating '...the server might be too busy to accept incoming connections' even though I'm the only one logging in as I have yet to implement SBS in our company.
I can however VPN into and access the server desktop via an intenal IP address without issue. Whilst I'm happy to VPN into the server, this is only convenient on PC's that have been setup for the VPN, such as mine at home.
I haven't reallly been able to find any definitive symptons, I'd appreciate any direction as to some of the more common causes.