Solved

Quick way to upload 300-500MB of data/database from tenant to our Cloud

Posted on 2014-10-20
8
294 Views
Last Modified: 2014-10-22
We run a Cloud & sometime we have customers who migrate their DB servers
to our Cloud using USB 2 / 3  portable HDDs but for 300-500GB, it takes
15-22 hours.

I suppose the laptop's USB2 port is the bottleneck beside the various overheads
from the sysadmin's LAN (where laptop connects to ) to the actual Prod VMs.

Q1:
Don't have that much time to do uploading.  Will it be any faster using a USB 3
portable drive (possibly the drive is a SSD inside) that connects directly to
the ESXi host's USB port?

Q2:
What's HP Proliant G7 & G8's USB port type?  USB3 or USB2 ?

Q3:
Or is it faster that the tenant/customer use a Gbit NAS & connect a cross-cable
direct to the ESXi host to do upload?  Is this against any security guideline?


Pls provide solutions that is as fast as possible without infringing infrastructure
security good practices.
0
Comment
Question by:sunhux
  • 5
  • 3
8 Comments
 

Author Comment

by:sunhux
ID: 40392490
Between USB3 & a Gigabit switch/laptop port, which one gives better
throughput?
0
 

Author Comment

by:sunhux
ID: 40392506
1 more query:
if a USB HDD is connected to an ESXi host's port, what's the command
to copy data from this USB HDD directly into a VM that's being hosted
inside this ESXi host?
0
 
LVL 117

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 500 total points
ID: 40392579
There is no fast method.

1. Upgrade your Internet bandwidth at your location. (e.g. we can upload 40GB in less than 3 minutes to our Datacenter!)

2. Physically take your data to the datacenter, and upload locally, but there will still be a delay.

Q1. ESXi does not support attaching USB to the Host Server. Only USB passthrough to the VM is supported. Transfer voia NFS.

Q2. USB 2.

Q3. This is the fatest method, NFS
0
 

Author Comment

by:sunhux
ID: 40393602
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?
0
What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

 
LVL 117

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE)
Andrew Hancock (VMware vExpert / EE MVE) earned 500 total points
ID: 40393757
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

You connect the NAS (NFS) to the ESXi host as a datastore.

and then copy the data, as you would from any datastore to datastore.

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?

This is also true, depends on the NAS. You cannot expect lighting speed from a NAS which costs $99!

from a laptop, you've got WinSCP, Veeam SCP or Datastore browser.

All methods are slow, you asked which is fastest.

NFS is fastest.

It's speed is also based on number of disks in the NAS.
0
 

Author Comment

by:sunhux
ID: 40394891
If I used a laptop, could this laptop serve as NFS server ?

Not all our tenants have NAS but laptops are certainly common
& especially the ones with 64bit CPU & 7200rpm HDDs, they
should outperform most NAS
0
 

Author Comment

by:sunhux
ID: 40394897
Laptop is running Windows 7.
What's the steps to make it act as NFS server, if there's any freeware to do this?
0
 
LVL 117
ID: 40394906
It's possible a laptop could be used as a NFS server.

What's the steps to make it act as NFS server, if there's any freeware to do this?

that's  a new question! I'm afraid.
0

Featured Post

Get up to 2TB FREE CLOUD per backup license!

An exclusive Black Friday offer just for Expert Exchange audience! Buy any of our top-rated backup solutions & get up to 2TB free cloud per system! Perform local & cloud backup in the same step, and restore instantly—anytime, anywhere. Grab this deal now before it disappears!

Join & Write a Comment

When we have a dead host and we lose all connections to the ESXi, and we need to find a way to move all VMs from that dead ESXi host.
In this article, I will show you HOW TO: Perform a Physical to Virtual (P2V) Conversion the easy way from a computer backup (image).
This Micro Tutorial walks you through using a remote console to access a server and install ESXi 5.1. This example is showing remote access and installation using a Dell server. The hypervisor is the very first component of your virtual infrastructu…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

757 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now