Solved

VMware ESXi vMotion using directly connected card without switch

Posted on 2014-11-20
7
1,135 Views
Last Modified: 2014-11-24
Hi guys,

I was trying to test a server that has 2x 1GB and 2x 10GB ports so I can move VMs from one host to the other using vMotion (no shared storage). The problem is, I don't have a 10GB switch so I've beem managing the servers through the 1GB ports connect to a switch, and the 10GB ports are connected directly from one server into the other, no switches in between.

On the 10GBIT cards, I set up IP address and GW (which can't really go anywhere as they are connected directly to each other) and I manage the servers using vCenter, which reach these servers through the switch using the 1GB ports. I enabled Vmotion on the 10GBIT ports, and tried to vMotion. It got stuck.

If I do the same on the 1GBIT ports, enabling vMotion on them, it works fine. I don't know if it is because the vMotion can't reach a gateway, but as everything is in the same subnet it should need a GW.

I heard that vMotion is actually a 2 item process:

1.

the cold migration will copy the VMDK files and will use the normal virtual network, not the vMotion network

2.

vMotion is actually just the memory state that will be copied over the network to the machine located on the new host, no VMDK files are involved in this step
Is this right?

Even though, I should be able to use the directly connected networks to migrate VMDK of vMotion the VMs to a different host. Why am I encountering this problem just when connecting the NICs directly to each other?

I was planning to get some infiniband cards as they are a cheap way to get 10-40GB without a switch, but if this is a limitation and I can't really internet the hosts properly and vMotion, it may not make much sense.

Thanks!
0
Comment
Question by:Alex
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 3
7 Comments
 
LVL 120
ID: 40454777
Your assumptions are correct.

and you can connect network ports between servers, providing you get an uplink, there is no need to use a switch.

Test your vMotion network (VMKernel Portgroups), using Ping, good communication is required between vMotion Portgroups for a vMotion to complete.

Have you tested the vMotion network?
0
 

Author Comment

by:Alex
ID: 40461859
That is why I could not understand why it didn't work.

10GB NICs have vmotion enabled, IP address and physical link.

I'm going to test again.

Also, I was wondering if I can make the normal traffic go between the hosts through the 10GB NICs, but still be managed on the 1GB NICs?

I would like to test moving VMs from one host to the other with the 10GB cards and no switch for example. I believe it can be done as people were using infiniband cards without switches.
0
 
LVL 120
ID: 40461869
You can select which interface you want to use for Management, and you can select which network interface you want to use for vMotion.

Remember vMotion network interfaces can have different interfaces, IP Addresses, and is usually recommended to be different networks.
0
Windows Server 2016: All you need to know

Learn about Hyper-V features that increase functionality and usability of Microsoft Windows Server 2016. Also, throughout this eBook, you’ll find some basic PowerShell examples that will help you leverage the scripts in your environments!

 

Author Comment

by:Alex
ID: 40461882
Can I also have multiple nics for management in a way I can force the traffic for example of moving VM to different host to got through the 10GB cards? Remember that I can't connect to these cards to manage remotely, they are connected directly to each host without a switch.

What I understand is that the management network is the network that also carries the traffic when VMs are being moved across hosts, so I'm wondering how I can achieve this.
0
 
LVL 120
ID: 40461907
VMotion of VMs, traffic goes through a vMotion Port.

Management Port is connected to vCenter Server.

Setup a new vMotion network on your 10GBe cards, with different IP Address, and ONLY flag these VMKernel Portgroups as vMotion.
0
 

Author Comment

by:Alex
ID: 40461917
This doesn't accomplish what I'm trying to do. I want to move VMDK disks over the 10GB cards too, not just the memory state through vMotion.

Can the move of VMDKs happen on a network that is not connected to vcenter?
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40461972
Okay, I understand Cold Migration and Hot Migration (vMotion).

NO, vCenter Server manages the Migration, so vCenter Server must have access to the servers, to perform the migration.
0

Featured Post

NEW Veeam Agent for Microsoft Windows

Backup and recover physical and cloud-based servers and workstations, as well as endpoint devices that belong to remote users. Avoid downtime and data loss quickly and easily for Windows-based physical or public cloud-based workloads!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

HOW TO: Upload an ISO image to a VMware datastore for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5) using the vSphere Host Client, and checking its MD5 checksum signature is correct.  It's a good idea to compare checksums, because many installat…
In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
This video shows you how to use a vSphere client to connect to your ESX host as the root user. Demonstrates the basic connection of bypassing certification set up. Demonstrates how to access the traditional view to begin managing your virtual mac…
In this video tutorial I show you the main steps to install and configure  a VMware ESXi6.0 server. The video has my comments as text on the screen and you can pause anytime when needed. Hope this will be helpful. Verify that your hardware and BIO…

738 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question