Solved

IP Storage Connections on LAN for ESXi

Posted on 2010-09-15
12
687 Views
Last Modified: 2013-11-14
I am currently in the process of expanding our Virtual Environment that has grown substancially over the past twelve months. We have just taken delivery of an Overland SAN S2000 with high speed disks and is now configured but I am struggling how to setup the network side and am looking for ideas.

Outline of environment:

- 3 x ESXi 4.0 hosts each with 4 NICS
- 1 SAN with 6 NICS
- 1 subnet

All iSCSI traffic and Management traffic in the past have gone down the same NIC's / Switches on the LAN and due to the size of the virtual environment network performance issues were not a problem but they certainly are now ...

So we need to seperate the iSCSI traffic with dedicated NICS that directly attach to the SAN off the LAN to improve performance.

I have a spare procurve to use if needed. (mostly likely)

How would you configure using the above information and why?

500 points for this as I've been tieing my head in knots trying to come to a conclusion!
0
Comment
Question by:Mr_OCD
  • 6
  • 4
  • 2
12 Comments
 
LVL 10

Accepted Solution

by:
BloodRed earned 250 total points
ID: 33684541
What speed is the extra Procurve switch?  Assuming it is a GB switch, I would create a second vSwitch on each ESXi host and assign it two uplinks.  Connect those uplinks to your Procurve switch, then connect the iSCSI interfaces on your SAN to that switch as well to create a separate storage network.  You could direct connect as you mention, but this setup will at least give you redundant links.  

Depending on how many iSCSI targets the SAN will allow you to configure (I'm not familiar with that model), you may still be restricted to a single GB link for your iSCSI traffic on each ESXi host due to the way ESXi handles iSCSI connections, but at least it will be on a dedicated network.  
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33684571
I would create seperate isolated networks (VLANs) for your iSCSI storage. Assuming two storage processors in your SAN, I would put each SP onto a seperate network (configure VLANs on your procurve to isolate them from one another) - then use two NICs on each of your ESXi boxes - one into each VLAN.

This will allow you take advantage of multi-pathing for performance, as well as fault tolerance.

Good Luck
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33684583
Note that you will need to present your datastore volumes to both storage processors...
0
Optimizing Cloud Backup for Low Bandwidth

With cloud storage prices going down a growing number of SMBs start to use it for backup storage. Unfortunately, business data volume rarely fits the average Internet speed. This article provides an overview of main Internet speed challenges and reveals backup best practices.

 

Author Comment

by:Mr_OCD
ID: 33685009
Procurve is a 1GB switch... I like the idea of a seperate vswitch on each host specifically for IP Storage.. will be obviously to any Staff looking at the configuration what the vswitch is for as well.

I presume would just set static IP addresses on the san and ESXi NIC's which connect to the switch then ensure the switch is routing properly? Is that it?!
0
 
LVL 28

Assisted Solution

by:bgoering
bgoering earned 250 total points
ID: 33685238
Yes, and routing is not even necessary as it is a requirement (for software iSCSI on ESX(i) anyway) that the VMkernel port and the storage be on the same IP subnet.

You will create:
vSwitch and bind to a vmnic (or two)
VMkernel port with IP on same subnet as storage
Leave gateway alone - only one gateway is allowed and it is more likely to be used on service console port.

If you follow my recommendation above you will repeat this and create yet another vSwitch and VMkernel port on different IP subnet and attach to 2nd storage processor on SAN for multipathing
0
 
LVL 10

Expert Comment

by:BloodRed
ID: 33685248
If you go with the seperate vSwitch and use the Procurve to create a storage network, you can just use non-routable IPs that are within the same subnet.  Ideal, you don't want to route storage traffic, so it's a general best practice to keep the iSCSI traffic within the same layer 2 subnet (which is what you get with a single non-routing switch).

Once that is configured, you'll have to make sure your iSCSI LUNs are presented to the ESXi initiators like bgoering said above, then you should be able to see your storage and access it.  
0
 

Author Comment

by:Mr_OCD
ID: 33685353
SAN only has one storage processor (although a second can be installed in the future) ...

Existing LAN is on 192.168.20.0/24 ... to keep it simple planned to keep all on same subnet with binded NIC's to the new vswitch / s on the hosts which connect directly to the SAN ports through the Procurve.

Make sense?

Looks like I was making it much harder than I needed ... always good to look at another persons approach!

You have both been very helpful so will split the points equally between you.
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33685419
You would need to go with a different IP subnet for your isolated storage network. Otherwise you would need to link the procurve to your existing switch because ESX will not be able to tell which network to use in order to access the storage. You already have a VMkernel port for the service console on your 192.168.20.0/24 network.

Besides most of the benefit occurs because you are isolating your storage traffic from your other traffic. Use something like 192.168.21.0/24 (anything so long as it is different) for your storage.

Good Luck
0
 

Author Comment

by:Mr_OCD
ID: 33691300
Ok Update time ...

Have setup the SAN's iSCSI NIC's on the 192.168.21.0/24 subnet ... have created new vSwitches on the ESX hosts with NIC also set to 192.168.21.0/24 subnet and everything is connected to the new switch installed...

I have created a test target on the SAN to see if it discovers under the iSCSI ESX initiator using the IP addresses setup for the iSCSI ESX traffic ... it is not discovering ...

Actually for the ESX initiator (dynamic list) should I be listing the SAN NIC's of the new ESX iSCSI traffic NICS?

0
 
LVL 28

Expert Comment

by:bgoering
ID: 33692135
Yes, enter the IP address(es) of the SAN for dynamic or static discovery
0
 
LVL 28

Expert Comment

by:bgoering
ID: 33692151
Guess I should add that on the SAN be sure to present to the iqns for each esx server that will share the storage and allow the ESX IP addresses. Are you using any security? chap?
0
 

Author Comment

by:Mr_OCD
ID: 33692254
Ok thanks. It seems I can see the SAN now but have network issues which I'm resolving now so should be fine once that is sorted. ESX isnt complaining anyway.

No CHAP setup.
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Learn how the use of a bunch of disparate tools requiring a lot of manual attention led to a series of unfortunate backup events for one company.
Each year, investment in cloud platforms grows more than 20% (https://www.immun.io/hubfs/Immunio_2016/Content/Marketing/Cloud-Security-Report-2016.pdf?submissionGuid=a8d80a00-6fee-4b85-81db-a4e28f681762) as an increasing number of companies begin to…
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This tutorial will show how to configure a new Backup Exec 2012 server and move an existing database to that server with the use of the BEUtility. Install Backup Exec 2012 on the new server and apply all of the latest hotfixes and service packs. The…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question