Veritas Backup Exec Backup to Amazon S3 is too slow to be useful
Running Backup Exec 15 and experimenting with duplication to Amazon Cloud. After trial and error, I was able to take a backup of a VMWare snapshot to a local NAS Device. The VMDK backup was about 26GB and takes about 16 minutes. That's quite acceptable. The job then takes this backup and duplicates it to the S3 Bucket we have setup in AWS. This same job takes 2 1/2 hours at a job rate of 186MB per minute. This is not acceptable.
While I realize that I'm not going to get GB speeds going to the cloud (we have a 50MB Fiber connection) this still seems ridiculous. Has anyone used this feature in BE 15 and if so, what kind of jobs and what kind of speeds are you getting? What do we need to do differently?
Thanks.
While I realize that I'm not going to get GB speeds going to the cloud (we have a 50MB Fiber connection) this still seems ridiculous. Has anyone used this feature in BE 15 and if so, what kind of jobs and what kind of speeds are you getting? What do we need to do differently?
Thanks.
how are you connecting to S3 - over the internet or a direct connection - again latency and bandwidth of course plays a factor in it
If you have a direct connect to AWS then you can configure the connection to lean the AWS S3 network address space over the direct path versus over the internet
If you have a direct connect to AWS then you can configure the connection to lean the AWS S3 network address space over the direct path versus over the internet
We use many Cloud Backup Technologies, including BE, but we do have the luxury of a mega fast circuit connected to the internet.
ASKER
As I mention, we have a 50M Internet Pipe. The setup to S3 is built into Backup Exec. I was not familiar with AWS Direct Connect, but I see it is a thing https://aws.amazon.com/directconnect/
My vendor is suggesting Datto as an alternative. BE is adequate in house, but it would be nice to have some depth of backups outside my office. I'm just not sure if BE is ideal for this.
My vendor is suggesting Datto as an alternative. BE is adequate in house, but it would be nice to have some depth of backups outside my office. I'm just not sure if BE is ideal for this.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
This is enough info to do further research. Would be nice if someone with BE experience participated.
It looks like your BE doesn't support S3 Multipart Upload, which provides benefits of uploading object parts in parallel. You can initiate multipart upload using Amazon S3 multipart upload CLI or special software (e.g.: CloudBerry Explorer, S3Browser or Bucket Explorer).
First, your broadband connection. Can you upgrade to 1000mb fibre optics broadband access?
The other factor is the physical location of Amazon S3 Bucket server. Is it in your country or outside your country? If outside, the speed of your ISP to connect to overseas is a crucial factor.
Actually, uploading 26gb in two and a half hour is already pretty fast and it is an apple to orange comparison if you compare local network speed with Internet network speed.