Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

Quick way to upload 300-500MB of data/database from tenant to our Cloud

Posted on 2014-10-20
8
Medium Priority
?
336 Views
Last Modified: 2014-10-22
We run a Cloud & sometime we have customers who migrate their DB servers
to our Cloud using USB 2 / 3  portable HDDs but for 300-500GB, it takes
15-22 hours.

I suppose the laptop's USB2 port is the bottleneck beside the various overheads
from the sysadmin's LAN (where laptop connects to ) to the actual Prod VMs.

Q1:
Don't have that much time to do uploading.  Will it be any faster using a USB 3
portable drive (possibly the drive is a SSD inside) that connects directly to
the ESXi host's USB port?

Q2:
What's HP Proliant G7 & G8's USB port type?  USB3 or USB2 ?

Q3:
Or is it faster that the tenant/customer use a Gbit NAS & connect a cross-cable
direct to the ESXi host to do upload?  Is this against any security guideline?


Pls provide solutions that is as fast as possible without infringing infrastructure
security good practices.
0
Comment
Question by:sunhux
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 3
8 Comments
 

Author Comment

by:sunhux
ID: 40392490
Between USB3 & a Gigabit switch/laptop port, which one gives better
throughput?
0
 

Author Comment

by:sunhux
ID: 40392506
1 more query:
if a USB HDD is connected to an ESXi host's port, what's the command
to copy data from this USB HDD directly into a VM that's being hosted
inside this ESXi host?
0
 
LVL 123

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 2000 total points
ID: 40392579
There is no fast method.

1. Upgrade your Internet bandwidth at your location. (e.g. we can upload 40GB in less than 3 minutes to our Datacenter!)

2. Physically take your data to the datacenter, and upload locally, but there will still be a delay.

Q1. ESXi does not support attaching USB to the Host Server. Only USB passthrough to the VM is supported. Transfer voia NFS.

Q2. USB 2.

Q3. This is the fatest method, NFS
0
Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:sunhux
ID: 40393602
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?
0
 
LVL 123

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 2000 total points
ID: 40393757
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

You connect the NAS (NFS) to the ESXi host as a datastore.

and then copy the data, as you would from any datastore to datastore.

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?

This is also true, depends on the NAS. You cannot expect lighting speed from a NAS which costs $99!

from a laptop, you've got WinSCP, Veeam SCP or Datastore browser.

All methods are slow, you asked which is fastest.

NFS is fastest.

It's speed is also based on number of disks in the NAS.
0
 

Author Comment

by:sunhux
ID: 40394891
If I used a laptop, could this laptop serve as NFS server ?

Not all our tenants have NAS but laptops are certainly common
& especially the ones with 64bit CPU & 7200rpm HDDs, they
should outperform most NAS
0
 

Author Comment

by:sunhux
ID: 40394897
Laptop is running Windows 7.
What's the steps to make it act as NFS server, if there's any freeware to do this?
0
 
LVL 123
ID: 40394906
It's possible a laptop could be used as a NFS server.

What's the steps to make it act as NFS server, if there's any freeware to do this?

that's  a new question! I'm afraid.
0

Featured Post

Looking for a new Web Host?

Lunarpages' assortment of hosting products and solutions ensure a perfect fit for anyone looking to get their vision or products to market. Our award winning customer support and 30-day money back guarantee show the pride we take in being the industry's premier MSP.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you’re involved with your company’s wide area network (WAN), you’ve probably heard about SD-WANs. They’re the “boy wonder” of networking, ostensibly allowing companies to replace expensive MPLS lines with low-cost Internet access. But, are they …
This article is in regards to the Cisco QSFP-4SFP10G-CU1M cables, which are designed to uplink/downlink 40GB ports to 10GB SFP ports. I recently experienced this and found very little configuration documentation on how these are supposed to be confi…
This course is ideal for IT System Administrators working with VMware vSphere and its associated products in their company infrastructure. This course teaches you how to install and maintain this virtualization technology to store data, prevent vuln…
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…

715 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question