Solved

Quick way to upload 300-500MB of data/database from tenant to our Cloud

Posted on 2014-10-20
8
322 Views
Last Modified: 2014-10-22
We run a Cloud & sometime we have customers who migrate their DB servers
to our Cloud using USB 2 / 3  portable HDDs but for 300-500GB, it takes
15-22 hours.

I suppose the laptop's USB2 port is the bottleneck beside the various overheads
from the sysadmin's LAN (where laptop connects to ) to the actual Prod VMs.

Q1:
Don't have that much time to do uploading.  Will it be any faster using a USB 3
portable drive (possibly the drive is a SSD inside) that connects directly to
the ESXi host's USB port?

Q2:
What's HP Proliant G7 & G8's USB port type?  USB3 or USB2 ?

Q3:
Or is it faster that the tenant/customer use a Gbit NAS & connect a cross-cable
direct to the ESXi host to do upload?  Is this against any security guideline?


Pls provide solutions that is as fast as possible without infringing infrastructure
security good practices.
0
Comment
Question by:sunhux
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 3
8 Comments
 

Author Comment

by:sunhux
ID: 40392490
Between USB3 & a Gigabit switch/laptop port, which one gives better
throughput?
0
 

Author Comment

by:sunhux
ID: 40392506
1 more query:
if a USB HDD is connected to an ESXi host's port, what's the command
to copy data from this USB HDD directly into a VM that's being hosted
inside this ESXi host?
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40392579
There is no fast method.

1. Upgrade your Internet bandwidth at your location. (e.g. we can upload 40GB in less than 3 minutes to our Datacenter!)

2. Physically take your data to the datacenter, and upload locally, but there will still be a delay.

Q1. ESXi does not support attaching USB to the Host Server. Only USB passthrough to the VM is supported. Transfer voia NFS.

Q2. USB 2.

Q3. This is the fatest method, NFS
0
Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:sunhux
ID: 40393602
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?
0
 
LVL 120

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40393757
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

You connect the NAS (NFS) to the ESXi host as a datastore.

and then copy the data, as you would from any datastore to datastore.

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?

This is also true, depends on the NAS. You cannot expect lighting speed from a NAS which costs $99!

from a laptop, you've got WinSCP, Veeam SCP or Datastore browser.

All methods are slow, you asked which is fastest.

NFS is fastest.

It's speed is also based on number of disks in the NAS.
0
 

Author Comment

by:sunhux
ID: 40394891
If I used a laptop, could this laptop serve as NFS server ?

Not all our tenants have NAS but laptops are certainly common
& especially the ones with 64bit CPU & 7200rpm HDDs, they
should outperform most NAS
0
 

Author Comment

by:sunhux
ID: 40394897
Laptop is running Windows 7.
What's the steps to make it act as NFS server, if there's any freeware to do this?
0
 
LVL 120
ID: 40394906
It's possible a laptop could be used as a NFS server.

What's the steps to make it act as NFS server, if there's any freeware to do this?

that's  a new question! I'm afraid.
0

Featured Post

Free learning courses: Active Directory Deep Dive

Get a firm grasp on your IT environment when you learn Active Directory best practices with Veeam! Watch all, or choose any amount, of this three-part webinar series to improve your skills. From the basics to virtualization and backup, we got you covered.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The following article is comprised of the pearls we have garnered deploying virtualization solutions since Virtual Server 2005 and subsequent 2008 RTM+ Hyper-V in standalone and clustered environments.
When you try to share a printer , you may receive one of the following error messages. Error message when you use the Add Printer Wizard to share a printer: Windows could not share your printer. Operation could not be completed (Error 0x000006…
In this video tutorial I show you the main steps to install and configure  a VMware ESXi6.0 server. The video has my comments as text on the screen and you can pause anytime when needed. Hope this will be helpful. Verify that your hardware and BIO…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

751 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question