Am I getting 10GB networking on my ESX hosts?

Hi, we recently went through an ESX and network upgrade.

We have 2 new hosts (local storage) with 10GB SFP+ NICs and 1GB Management NIC

We have a bunch of 3750X switches as well that we got 10GB SFP+ modules for....

I attached a diagram of how everything is connected....but I dont seem to be getting any network speed improvements (backups and even simple file transfers between servers), I was hoping the ESX hosts would 'talk' to the other servers over the 10GB network, and definitely at least between the VMs on the 2 new hosts that have the 10GB SFP+ ports

Note that the red ports are 1GB ports and the blue ones are 10GB ports
Layout.JPG
s aitAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Don JohnstonInstructorCommented:
Well, the backplane of the 3750x is more than sufficient to handle 10 or 20 gig.

So assuming that you have to correct modules installed in the switch with the correct SFP+ and the server NIC's are 10g capable, I would check that all the interfaces in question are correctly configured.

What speed are you getting?
0
s aitAuthor Commented:
Getting 1 GB/s when transferring files between servers....

Switch 1 and 2 are stacked
Switch 3 and 4 are stacked


Does the diagram look right?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Can you upload screenshots of your VMware Networking, from vSphere Client, and let me know which are 10GBe?
0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

Don JohnstonInstructorCommented:
Is that 1 gigaBYTE per second or 1 gigabit per second?

You should be getting 10g between the servers even without stacking since both servers are connected to a common switch.

But there are other factors involved such as how are the vNIC's, vswitch and physical NIC's are configured.

If you are only getting 1 gigabit per second, I would start by verifying the speed of the switchports.
0
s aitAuthor Commented:
1 GB / s.... so I think gigabyte

Andrew...see attached.
Does my diagram look right?
network.JPG
network2.JPG
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Okay, so you have connected the 10GBe to your group of virtual machines.

What are you expecting to get faster ?
0
Don JohnstonInstructorCommented:
1 GB / s.... so I think gigabyte
One gigabyte per second would be at least 8 gigabits/per second.  So if that's what you're getting, I'd say that you're in good shape.
0
s aitAuthor Commented:
Andrew....file transfers between windows machines and backups.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
where are the backups stored, how are the backups done for Windows ?
0
s aitAuthor Commented:
VMs are being replicated from HostA to B and vice versa.

as for file transfers, is 1 GB / s about right?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
okay, so Hosts are being replicated from host A to host B, and which network are they being replicated over - the Management Network ?

What is doing the replication at the Host level, or at the OS ?
0
Gerald ConnollyCommented:
A 10GbE Link (ie 10Gigabits/sec) = 1 GigaByte/sec  - due to physical signalling and other overheads plan on 10 bits/byte over comms links

So if you are getting 1GByte/s then thats good, it is Ethernet after all, if its 1 Gbit/s (=100MB/s) then thats not good, but could be down to how fast your storage can deliver data
0
James HoodAssistant Technical Manager (IT Infrastructure)Commented:
Check the virtual network adapters on your VM's, I can't say for certain but I believe you need to set your adapters to use the VMXNET3 adapter (the VMware one) as opposed to the standard E1000 (Intel-based, default in most cases) to get 10 gig connectivity to the VM's. Just be aware that you need to ensure you have VMware tools installed for most OS's to ensure the drivers are available for it and Windows will probably see it as a new adapter once changed so you'll need to reconfigure it on each VM.

Let me know how you get on.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.