How to configure 2nd private cross-over cabled NIC?

Hi. I have 2 Windows 2012 Server on a LAN 192.168.0.x, 255.255.255.0, 192.168.0.1

I've just added a 10GB Ethernet card to each server and connected them with an Ethernet cable (10G uses straight not cross over cables - built in auto sense). I've assigned server#1 Ethernet 192.168.5.11,255.255.255.0, no gateway and did the second server NIC the same way with 192.168.5.41

The cards report they are each connected at 10GB and now I just need a way to use them to move virtual machines from one server to the other.

I guess I need a static route, but everything I find on the Internet say I need a destination router to make it work.

Please help and tell me the static route line that is needed to make this work. I can change whatever is needed on the 10G NIC settings, but cannot change the LAN settings the other 1GB normal cards are using.

Thank You!
LVL 1
johnj_01201Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Darr247Commented:
Open a cmd window and run
route print

To what interface is the routing table currently sending traffic with a destination of 192.168.5.0 / 255.255.255.0 ?
(do that on both machines... note that each packet is processed from the bottom of the routing table to the top, and the first rule it matches on the way up determines to what interface the packet is sent.)
0
johnj_01201Author Commented:
I didn't want to tell you the wrong thing, so here's the route print from both servers:
The "Intel(R) Ethernet Converged Network Adapter X540-T2" are the connected NIC ports. They are dual port cards, but I'm only using 1 port on each card at the moment.

Server#1:
C:\Windows\system32>route print
===========================================================================
Interface List
 25...00 1e 67 4d b8 07 ......Hyper-V Virtual Ethernet Adapter #2
 16...a0 36 9f 1f c4 2c ......Intel(R) Ethernet Converged Network Adapter X540-T2 #2
 12...a0 36 9f 1f c4 2e ......Intel(R) Ethernet Converged Network Adapter X540-T2
  1...........................Software Loopback Interface 1
 18...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter
 22...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter #2
===========================================================================

IPv4 Route Table
===========================================================================
Active Routes:
Network Destination        Netmask          Gateway       Interface  Metric
          0.0.0.0          0.0.0.0      192.168.0.1     192.168.0.96      5
          0.0.0.0          0.0.0.0         On-link      192.168.5.11    261
        127.0.0.0        255.0.0.0         On-link         127.0.0.1    306
        127.0.0.1  255.255.255.255         On-link         127.0.0.1    306
  127.255.255.255  255.255.255.255         On-link         127.0.0.1    306
      192.168.0.0    255.255.255.0         On-link      192.168.0.96    261
     192.168.0.96  255.255.255.255         On-link      192.168.0.96    261
    192.168.0.255  255.255.255.255         On-link      192.168.0.96    261
      192.168.5.0    255.255.255.0         On-link      192.168.5.11    261
     192.168.5.11  255.255.255.255         On-link      192.168.5.11    261
    192.168.5.255  255.255.255.255         On-link      192.168.5.11    261
        224.0.0.0        240.0.0.0         On-link         127.0.0.1    306
        224.0.0.0        240.0.0.0         On-link      192.168.0.96    261
        224.0.0.0        240.0.0.0         On-link      192.168.5.11    261
  255.255.255.255  255.255.255.255         On-link         127.0.0.1    306
  255.255.255.255  255.255.255.255         On-link      192.168.0.96    261
  255.255.255.255  255.255.255.255         On-link      192.168.5.11    261
===========================================================================
Persistent Routes:
  None

IPv6 Route Table
===========================================================================
Active Routes:
 If Metric Network Destination      Gateway
  1    306 ::1/128                  On-link
 25    261 fe80::/64                On-link
 25    261 fe80::b195:962c:9106:5f7c/128
                                    On-link
  1    306 ff00::/8                 On-link
 25    261 ff00::/8                 On-link
===========================================================================
Persistent Routes:
  None


SERVER#2:
===========================================================================
Interface List
 27...a0 36 9f 23 ad 30 ......Intel(R) Ethernet Converged Network Adapter X540-T2 #2
 26...a0 36 9f 23 ad 32 ......Intel(R) Ethernet Converged Network Adapter X540-T2
 24...00 1b 21 85 a9 75 ......Hyper-V Virtual Ethernet Adapter #2
  1...........................Software Loopback Interface 1
 16...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter
 18...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter #2
 21...00 00 00 00 00 00 00 e0 Teredo Tunneling Pseudo-Interface
===========================================================================

IPv4 Route Table
===========================================================================
Active Routes:
Network Destination        Netmask          Gateway       Interface  Metric
          0.0.0.0          0.0.0.0     192.168.5.44     192.168.5.41    261
          0.0.0.0          0.0.0.0      192.168.0.1    192.168.0.106      5
        127.0.0.0        255.0.0.0         On-link         127.0.0.1    306
        127.0.0.1  255.255.255.255         On-link         127.0.0.1    306
  127.255.255.255  255.255.255.255         On-link         127.0.0.1    306
      192.168.0.0    255.255.255.0         On-link     192.168.0.106    261
    192.168.0.106  255.255.255.255         On-link     192.168.0.106    261
    192.168.0.255  255.255.255.255         On-link     192.168.0.106    261
      192.168.5.0    255.255.255.0         On-link      192.168.5.41    261
     192.168.5.41  255.255.255.255         On-link      192.168.5.41    261
    192.168.5.255  255.255.255.255         On-link      192.168.5.41    261
        224.0.0.0        240.0.0.0         On-link         127.0.0.1    306
        224.0.0.0        240.0.0.0         On-link     192.168.0.106    261
        224.0.0.0        240.0.0.0         On-link      192.168.5.41    261
  255.255.255.255  255.255.255.255         On-link         127.0.0.1    306
  255.255.255.255  255.255.255.255         On-link     192.168.0.106    261
  255.255.255.255  255.255.255.255         On-link      192.168.5.41    261
===========================================================================
Persistent Routes:
  Network Address          Netmask  Gateway Address  Metric
          0.0.0.0          0.0.0.0     192.168.5.44  Default
===========================================================================

IPv6 Route Table
===========================================================================
Active Routes:
 If Metric Network Destination      Gateway
  1    306 ::1/128                  On-link
 24    261 fe80::/64                On-link
 24    261 fe80::90e8:f3e7:9117:4e24/128
                                    On-link
  1    306 ff00::/8                 On-link
 24    261 ff00::/8                 On-link
===========================================================================
Persistent Routes:
  None
0
peeaCommented:
For both servers, the additional NIC connecting to each other through the cross-over cable does not need default gateway, just leave it empty.

They both do not need DNS settings, too. However, in this case from each server you need to use the private IP (192.168.5.x), instead of DNS name, to address each other.

You may also manually disable the firewall for the private link too.
0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

johnj_01201Author Commented:
I just double checked, the configurations do not have a default gateway or DNS servers. They did to begin with, but I removed them after reading on the Internet they should not have any. I don't know why they still show as having any in the route print.
0
johnj_01201Author Commented:
I rebooted and found one NIC had the old gateway on server #2:
Here's the new printout:

===========================================================================
Interface List
 27...a0 36 9f 23 ad 30 ......Intel(R) Ethernet Converged Network Adapter X540-T2 #2
 26...a0 36 9f 23 ad 32 ......Intel(R) Ethernet Converged Network Adapter X540-T2
 24...00 1b 21 85 a9 75 ......Hyper-V Virtual Ethernet Adapter #2
  1...........................Software Loopback Interface 1
 16...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter
 18...00 00 00 00 00 00 00 e0 Microsoft ISATAP Adapter #2
 21...00 00 00 00 00 00 00 e0 Teredo Tunneling Pseudo-Interface
===========================================================================

IPv4 Route Table
===========================================================================
Active Routes:
Network Destination        Netmask          Gateway       Interface  Metric
          0.0.0.0          0.0.0.0      192.168.0.1    192.168.0.106      5
        127.0.0.0        255.0.0.0         On-link         127.0.0.1    306
        127.0.0.1  255.255.255.255         On-link         127.0.0.1    306
  127.255.255.255  255.255.255.255         On-link         127.0.0.1    306
      192.168.0.0    255.255.255.0         On-link     192.168.0.106    261
    192.168.0.106  255.255.255.255         On-link     192.168.0.106    261
    192.168.0.255  255.255.255.255         On-link     192.168.0.106    261
      192.168.5.0    255.255.255.0         On-link      192.168.5.41    261
     192.168.5.41  255.255.255.255         On-link      192.168.5.41    261
    192.168.5.255  255.255.255.255         On-link      192.168.5.41    261
        224.0.0.0        240.0.0.0         On-link         127.0.0.1    306
        224.0.0.0        240.0.0.0         On-link     192.168.0.106    261
        224.0.0.0        240.0.0.0         On-link      192.168.5.41    261
  255.255.255.255  255.255.255.255         On-link         127.0.0.1    306
  255.255.255.255  255.255.255.255         On-link     192.168.0.106    261
  255.255.255.255  255.255.255.255         On-link      192.168.5.41    261
===========================================================================
Persistent Routes:
  None

IPv6 Route Table
===========================================================================
Active Routes:
 If Metric Network Destination      Gateway
  1    306 ::1/128                  On-link
 24    261 fe80::/64                On-link
 24    261 fe80::90e8:f3e7:9117:4e24/128
                                    On-link
  1    306 ff00::/8                 On-link
 24    261 ff00::/8                 On-link
===========================================================================
Persistent Routes:
  None
0
Darr247Commented:
They both look good... in what way is it not working?

Can you ping server 1 (192.168.5.11) from server 2 (192.168.5.41) ?
And vice-versa?
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
johnj_01201Author Commented:
Your right, Firewall was preventing PING.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Windows Server 2012

From novice to tech pro — start learning today.