Hi, I have an ESXi 5.0 host with a mix of Server 2008R2 and 2012 Servers guests. I am trying to connect a second physical Server 2012 machine to this host via Infiniband so that I'll have a fast link to the host for backup purposes. This is a direct connection - I don't have an infiniband switch; just two cards and a cable. OpenSM is running on the standalone Server 2012 machine.
Ideally, I would like to set the Mellanox as pci-pass-through to one of the VM's; especially a Server 2012 VM so that I can take advantage of the new SMB 3.0 functionality. However, I have not been able to do this as the Server 2012 VM will crash whenever I add the card to its configuration. Interesting however, that in this paper, it appears that pci passthrough is possible: http://labs.vmware.com/publications/ib-researchnote-apr2012
But after some googling, others are having the same reboot problem I have.
Therefore, my second alternative is not to pass-through, but to setup the card as IPoIB at the ESXi host level. I've done this and at this point, I can ping between a VM and the standalone Server 2012 Server. On the guest VM, I have two vNIC's, a "regular" one with internet access which has an IP of 192.168.1.2/255.255.255.0.
The second vNIC is on the "infiniband" network which is set to 192.168.2.1/255.255.255.0 - there is no default gateway set on this second vNIC.
On the standalone server, the setup is similar - 192.168.1.3 for "regular" and 192.168.2.2 for the infiniband card. On this server, I removed Windows File and Printer sharing on the regular NIC, but kept it checked on the Infiniband NIC with the hope that this will "channel" all the file sharing / copying packets via the fast infiniband connection (not sure if this is the best way to do it, but the only way I thought of).
My problem at this point is that while I can ping from each machine to the other via the Infiniband connection (eg ping 192.168.2.1 and ping 192.168.2.2), this connection is showing up as "public and unidentified" by Windows on both the VM guest and the standalone server. As such, I can't see the shared folders I have set up and without that, I can't copy the files to be backed up to the standalone 2012 Server.
Any thoughts either to solve the public and unidentified network problem or is there a better way to accomplish what I an trying to do.
If there is a way to pass through the Infiniband card, that would be best, but I can live with an alternative. The cards I have are MHQH19B-XTR and both have been updated with the latest firmware from the Mellanox website.