Solved

Quick way to upload 300-500MB of data/database from tenant to our Cloud

Posted on 2014-10-20
8
317 Views
Last Modified: 2014-10-22
We run a Cloud & sometime we have customers who migrate their DB servers
to our Cloud using USB 2 / 3  portable HDDs but for 300-500GB, it takes
15-22 hours.

I suppose the laptop's USB2 port is the bottleneck beside the various overheads
from the sysadmin's LAN (where laptop connects to ) to the actual Prod VMs.

Q1:
Don't have that much time to do uploading.  Will it be any faster using a USB 3
portable drive (possibly the drive is a SSD inside) that connects directly to
the ESXi host's USB port?

Q2:
What's HP Proliant G7 & G8's USB port type?  USB3 or USB2 ?

Q3:
Or is it faster that the tenant/customer use a Gbit NAS & connect a cross-cable
direct to the ESXi host to do upload?  Is this against any security guideline?


Pls provide solutions that is as fast as possible without infringing infrastructure
security good practices.
0
Comment
Question by:sunhux
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 3
8 Comments
 

Author Comment

by:sunhux
ID: 40392490
Between USB3 & a Gigabit switch/laptop port, which one gives better
throughput?
0
 

Author Comment

by:sunhux
ID: 40392506
1 more query:
if a USB HDD is connected to an ESXi host's port, what's the command
to copy data from this USB HDD directly into a VM that's being hosted
inside this ESXi host?
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40392579
There is no fast method.

1. Upgrade your Internet bandwidth at your location. (e.g. we can upload 40GB in less than 3 minutes to our Datacenter!)

2. Physically take your data to the datacenter, and upload locally, but there will still be a delay.

Q1. ESXi does not support attaching USB to the Host Server. Only USB passthrough to the VM is supported. Transfer voia NFS.

Q2. USB 2.

Q3. This is the fatest method, NFS
0
Visualize your virtual and backup environments

Create well-organized and polished visualizations of your virtual and backup environments when planning VMware vSphere, Microsoft Hyper-V or Veeam deployments. It helps you to gain better visibility and valuable business insights.

 

Author Comment

by:sunhux
ID: 40393602
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?
0
 
LVL 120

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40393757
So using an NAS that provides NFS & plug this NAS into the same
switch (to a port of same VLan) as the ESXi host is fastest.  How
do we copy it out from the NAS' NFS to the VM?  Scp or mapping
a drive on the VM to the NAS?

You connect the NAS (NFS) to the ESXi host as a datastore.

and then copy the data, as you would from any datastore to datastore.

I heard some NAS throughputs is much lower than laptops as the
NAS runs atom CPU only, so wouldn't it be faster if I connect a
laptop (that has SSD with Gigabit NIC) to the switch port?  For
this, do we map a drive to the laptop or what's the secure
way of copying files/data from the laptop to the VM?

This is also true, depends on the NAS. You cannot expect lighting speed from a NAS which costs $99!

from a laptop, you've got WinSCP, Veeam SCP or Datastore browser.

All methods are slow, you asked which is fastest.

NFS is fastest.

It's speed is also based on number of disks in the NAS.
0
 

Author Comment

by:sunhux
ID: 40394891
If I used a laptop, could this laptop serve as NFS server ?

Not all our tenants have NAS but laptops are certainly common
& especially the ones with 64bit CPU & 7200rpm HDDs, they
should outperform most NAS
0
 

Author Comment

by:sunhux
ID: 40394897
Laptop is running Windows 7.
What's the steps to make it act as NFS server, if there's any freeware to do this?
0
 
LVL 120
ID: 40394906
It's possible a laptop could be used as a NFS server.

What's the steps to make it act as NFS server, if there's any freeware to do this?

that's  a new question! I'm afraid.
0

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
How to fid Policy on particular IP Address 5 47
TLS 1.0 & Windows 7 - How to disable? 16 114
VLAN 1 Line Protocol Down 9 34
VM replication scenario and caveats ? 6 40
If we need to check who deleted a Virtual Machine from our vCenter. Looking this task in logs can be painful and spend lot of time, so the best way to check this is in the vCenter DB. Just connect to vCenter DB(default DB should be VCDB and using…
For many of us, the  holiday season kindles the natural urge to give back to our friends, family members and communities. While it's easy for friends to notice the impact of such deeds, understanding the contributions of businesses and enterprises i…
Viewers will learn how to connect to a wireless network using the network security key. They will also learn how to access the IP address and DNS server for connections that must be done manually. After setting up a router, find the network security…
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question