Quick way to upload 300-500MB of data/database from tenant to our Cloud

We run a Cloud & sometime we have customers who migrate their DB servers
to our Cloud using USB 2 / 3  portable HDDs but for 300-500GB, it takes
15-22 hours.

I suppose the laptop's USB2 port is the bottleneck beside the various overheads
from the sysadmin's LAN (where laptop connects to ) to the actual Prod VMs.

Q1:
Don't have that much time to do uploading.  Will it be any faster using a USB 3
portable drive (possibly the drive is a SSD inside) that connects directly to
the ESXi host's USB port?

Q2:
What's HP Proliant G7 & G8's USB port type?  USB3 or USB2 ?

Q3:
Or is it faster that the tenant/customer use a Gbit NAS & connect a cross-cable
direct to the ESXi host to do upload?  Is this against any security guideline?


Pls provide solutions that is as fast as possible without infringing infrastructure
security good practices.
sunhuxAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

sunhuxAuthor Commented:
Between USB3 & a Gigabit switch/laptop port, which one gives better
throughput?
0
sunhuxAuthor Commented:
1 more query:
if a USB HDD is connected to an ESXi host's port, what's the command
to copy data from this USB HDD directly into a VM that's being hosted
inside this ESXi host?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
There is no fast method.

1. Upgrade your Internet bandwidth at your location. (e.g. we can upload 40GB in less than 3 minutes to our Datacenter!)

2. Physically take your data to the datacenter, and upload locally, but there will still be a delay.

Q1. ESXi does not support attaching USB to the Host Server. Only USB passthrough to the VM is supported. Transfer voia NFS.

Q2. USB 2.

Q3. This is the fatest method, NFS
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

sunhuxAuthor Commented:
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

You connect the NAS (NFS) to the ESXi host as a datastore.

and then copy the data, as you would from any datastore to datastore.

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?

This is also true, depends on the NAS. You cannot expect lighting speed from a NAS which costs $99!

from a laptop, you've got WinSCP, Veeam SCP or Datastore browser.

All methods are slow, you asked which is fastest.

NFS is fastest.

It's speed is also based on number of disks in the NAS.
0
sunhuxAuthor Commented:
If I used a laptop, could this laptop serve as NFS server ?

Not all our tenants have NAS but laptops are certainly common
& especially the ones with 64bit CPU & 7200rpm HDDs, they
should outperform most NAS
0
sunhuxAuthor Commented:
Laptop is running Windows 7.
What's the steps to make it act as NFS server, if there's any freeware to do this?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
It's possible a laptop could be used as a NFS server.

What's the steps to make it act as NFS server, if there's any freeware to do this?

that's  a new question! I'm afraid.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.