Solved

How to move 200 Gigs to Amazon S3

Posted on 2016-09-08
4
79 Views
Last Modified: 2016-09-09
What is the best way to transfer 200 gigs of 100kb images from a Dedicated Server to Amazon S3.
0
Comment
Question by:cxs410
4 Comments
 
LVL 52

Expert Comment

by:Julian Hansen
ID: 41790466
Amazon Snowball is a possible option you can read more about it here
http://docs.aws.amazon.com/AWSImportExport/latest/ug/whatissnowball.html
AWS Import/Export is a service that accelerates transferring large amounts of data into and out of AWS using physical storage appliances, bypassing the Internet. AWS Import/Export has two features that support this functionality in two different ways, AWS Snowball (Snowball) and AWS Import/Export Disk (Disk).
0
 

Author Comment

by:cxs410
ID: 41790546
I was hoping for some kind of server to service connection.
0
 
LVL 4

Accepted Solution

by:
Laroy Shtotland earned 500 total points
ID: 41790564
Server to service connection? If you are talking about AWS Direct Connect  it's not the case for it.

Data Transfer IN To Amazon S3 is free. Your 2097152 PUT requests (200 GB = 209715200 KB = 209715200 KB / 100 KB) will cost you 10$, if you need each of the files as an object, so it doesn't matter how you upload those files.

You will not be able to use multipart upload APIs for multiple threads in parallel for objects less than 15MB,

I think a faster way is to fire up a free EC2 micro instance, upload zip archives there, unzip, and then PUT those files to S3 from EC2.

I also heard about www.cloudzipinc.com but I haven't had an opportunity to try it myself yet.
0
 
LVL 16

Expert Comment

by:Gerald Connolly
ID: 41791054
Of course your connection speed to the Internet/AWS is going to factor in how long its going to take to upload,

200GBytes on a 100Mbit link is probably going to take in excess of 10 Hours
0

Featured Post

Why are Office 365 signatures so complicated?

Trying to setup transport rules for Office 365 email signatures and can’t quite figure it out? Having to test the signature over and over? Make things simple by using Exclaimer Cloud - Signatures for Office 365.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
AWS EC2 Linux 1 55
ASP.Net Session State alternatives 3 60
AWS VPS as AD Server 2 55
Background graphic on all pages at a Drupal website has disappeared 8 21
Any business that wants to seriously grow needs to keep the needs and desires of an international audience of their websites in mind. Making a website friendly to international users isn’t prohibitively expensive and can provide an incredible return…
Get to know the ins and outs of building a web-based ERP system for your enterprise. Development timeline, technology, and costs outlined.
This Micro Tutorial will explain how to export DynamoDB tables in Amazon Web Services.
Both in life and business – not all partnerships are created equal. Spend 30 short minutes with us to learn:   • Key questions to ask when considering a partnership to accelerate your business into the cloud • Pitfalls and mistakes other partners…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now