iSCSI LUN Backup Using Synology NAS Over Internet - Slow Speeds
I am trying to get an off-site backup solution running for my company. I am using an iSCSI LUN on a Synology RackStation for data storage at my office, and I have another Synology RackStation at my home. The LUN is thin provisioned for 2TB, but we're currently only using ~25GB.
I opened up the required TCP ports on my home firewall (873 & 3260), setup the backup on the NAS at my office, and initiated the first backup. I have an upstream speed of ~8Mbps at my office, and downstream of 50Mbps at my home (both are business class connections), and the resource monitor of each NAS is showing ~1MB/s for the transfer speed, so it's correct. In theory, it should take a little over 7 hours to complete the backup.
After about 12 hours, I checked the status and only 6% was completed. I thought that maybe since the LUN is provisioned for 2TB, it was trying to transfer 2TB of data, but that would be over 120GB of data in 12 hours, and there's no way my connection could upload 10GB per hour. I checked the resource monitor, and it was transferring at about 20KB/s. I tested the network connections at my home and office, and both were fine. I decided to stop the transfer and try it again. It started out again at ~1MB/s, but after about 6 hours, it was back down to ~20KB/s.
I'm at a loss of what the problem could be. I am now about an hour into another attempt for the backup. It's still reading between 700KB/s and 1.3MB/s for the transfer speed, but the backup dialog on the NAS at my office is still says 0%. If it has been transferring at ~1MB/s for an hour, it should be somewhere around 14% completed.
Hopefully someone has some experience with Synology or LUN backups and can give me some insight. I am using a SonicWALL TZ 215 firewall at my office and an ASUS RT-AC87U at my home. Each RackStation has 2x 1GbE ports, which I have bonded and given a single static IP address.
I opened up the required TCP ports on my home firewall (873 & 3260), setup the backup on the NAS at my office, and initiated the first backup. I have an upstream speed of ~8Mbps at my office, and downstream of 50Mbps at my home (both are business class connections), and the resource monitor of each NAS is showing ~1MB/s for the transfer speed, so it's correct. In theory, it should take a little over 7 hours to complete the backup.
After about 12 hours, I checked the status and only 6% was completed. I thought that maybe since the LUN is provisioned for 2TB, it was trying to transfer 2TB of data, but that would be over 120GB of data in 12 hours, and there's no way my connection could upload 10GB per hour. I checked the resource monitor, and it was transferring at about 20KB/s. I tested the network connections at my home and office, and both were fine. I decided to stop the transfer and try it again. It started out again at ~1MB/s, but after about 6 hours, it was back down to ~20KB/s.
I'm at a loss of what the problem could be. I am now about an hour into another attempt for the backup. It's still reading between 700KB/s and 1.3MB/s for the transfer speed, but the backup dialog on the NAS at my office is still says 0%. If it has been transferring at ~1MB/s for an hour, it should be somewhere around 14% completed.
Hopefully someone has some experience with Synology or LUN backups and can give me some insight. I am using a SonicWALL TZ 215 firewall at my office and an ASUS RT-AC87U at my home. Each RackStation has 2x 1GbE ports, which I have bonded and given a single static IP address.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
@Andrew Hancock, the main reason I'm trying to get the Synology-to-Synology solution working is because I already had both NAS devices in place (at my office for file storage and at home for my personal storage), so why not use them? Also, I prefer to have a physical backup available. I'm currently backing up our data daily to USB drives, but the Synology-to-Synology backup would give me an automated physical backup.
less chance Amazon will be destroyed or house burgled, and they have more bandwidth!
I think those numbers from Zen are a little over optimistic. They seem to assume that a 10Mbps = 1.2MBps so gives 5GBph, they obviously haven't heard of the 10 bits per Byte overhead of a comms link, or the fact it's really really hard to drive a link at 100% for an extended period.
Getting 2GBph would be a result!
50GB over a 8Mb link is max 800KBps = 17.5 hours, probably more like 25-30 hours
Getting 2GBph would be a result!
50GB over a 8Mb link is max 800KBps = 17.5 hours, probably more like 25-30 hours
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
@Gerald - actually it's not far off, and they're conservative, and your calculation is slightly off too :-)
Of course, those figures are aimed at what they estimate you should expect when backing up to their Cloud using one of their circuits, but I think practically doubling the predicted time is a bit too harsh.
Also, given that this scenario uses the same ISP throughout I think we can ignore some of the other issues which may affect this, such as irregular QoS markings or different traffic policing policies between providers, etc.
Of course, those figures are aimed at what they estimate you should expect when backing up to their Cloud using one of their circuits, but I think practically doubling the predicted time is a bit too harsh.
Also, given that this scenario uses the same ISP throughout I think we can ignore some of the other issues which may affect this, such as irregular QoS markings or different traffic policing policies between providers, etc.
ASKER
Just wanted to post an update that the Synology iSCSI LUN backup does not perform a full backup every time. It will only update the 4GB blocks that have had changes made to them. I deleted and added quite a few files to the iSCSI target, only 3 of the 4GB blocks had updated modified dates, and it completed in about 3 hours.
ASKER
Best solution: Synology LUN Backup will backup the thin provisioned capacity of the LUN, not just the storage space currently being used.
Correct, that's why I don't understand why you are messing around with any other solutions!
You cannot beat or compete with Amazon!