Configuring Storage Switches IP address

Configuring Storage Switches IP address

vm
in the topology above, ESX1 and ESX2 hosts "VmkStorage " have ports 7 and 8 connected to 2 separate  Storage Switches, then to Storage Devices.
I would like to understand the recommendation of configuring ports 7 and 8 on ESX hosts. their connection to storage Switches (should each port  connect to separate SW switch )?
will storage switch be configured with IP address? if so how ? would the Nics be teamed ?

Any clarification will be very much appreciated.

Thank you
STORAGE-Vmware.xlsx
jskfanAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
will storage switch be configured with IP address? if so how ? would the Nics be teamed ?

Usually you would configure the storage switch with an IP Address for Management Purposes, but that's got nothing to do with VMware vSphere, and does not make any difference if it has a IP Address or not.

As for Teamed, depends on the Storage. If this was NetApp storage, you could create a Teamed Bonded Link to each controller.

Your design should create at least two paths to storage, and should handle a single point of failure in network interfaces in host, and also switches

When it comes to Storage (SANs./NAS) you need to follow their recommendations and guides, there is no, this way for everything....
0
jskfanAuthor Commented:
Andrew
I am sure you have experience connecting   ESX hosts to Network and Storage Switches.

let's talk just about Storage in this thread:
 when you create VmKernel for Storage, you put it in separate subnet from other Vmkernels and VMportgroups.
in the example above the NICs of ESX hosts assigned to VMkernel Storage are Nics7 and 8 on each ESX host.
Those Nics 7 and 8 are connected separately to 2 different Storage switches, for redundancy  sake.
How are you going to configure the port on Storage Switch to be on the same subnet so as to match the subnet of Nics 7 and 8 ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Yes lots of experience and it depends on the storage

[quote]when you create VmKernel for Storage, you put it in separate subnet from other Vmkernels and VMportgroups.[/quote]

it's recommended to create a storage network. so ideally a non-routable different IP Address scheme.
[quote]
How are you going to configure the port on Storage Switch to be on the same subnet so as to match the subnet of Nics 7 and 8 ?[/quote]

Why do you need to configure anything here ? If I want to run 10.10.1.1 I don't have to configure the switch to run that traffic over the physical switch....

if we want to isolated traffic....we may consider using VLANS, but traffic on 10.10.1.1 and 192.168.1.1 is not going to conflict....but you can contain it in its own pipe - VLAN

We would ensure, that the Storage Switch has VLANS enabled, and those ports on the physical switch are in a specific storage VLAN. but depends if this switch is being used for anything else.

if it was JUST for these, VLANs probably not required.
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

jskfanAuthor Commented:
If you look at ESX host 1 and ESX host 2.
They have Nic 7 and 8 going to 2 different Storage Switches. is this correct wiring ? if so will NIC 7 and 8 be teamed up ?
if you assigned the Vmkernel for storage IP address 10.10.10.100/24 , which IP address will be its default gateway ? will it be the the Storage device itself ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
does not need a default gateway it's not routing traffic and the Storage Switch may not have an IP Address, and only an IP Address for Management.

looks correct follow the paths, when they fail.

It's all really hypothetical because it's not a real configuration
0
jskfanAuthor Commented:
OK will Vmkernel need an IP address ? I believe so
Will Storage Device need an IP address ? I believe so
Nic7 and Nic 8 , one should be Active and the other in Standby ?
cannot we make them Active/Active and teamed up if they are connected to 2 different Storage Switches ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
OK will Vmkernel need an IP address ? I believe so

WHY ?

Will Storage Device need an IP address ? I believe so

WHY ?

Nic7 and Nic 8 , one should be Active and the other in Standby ?

A possible configuration of many. Yes and No, depends on what configuration you are trying to configure for the Storage, you need to understand the storage requirements. e.g. vendor, read the instructions and guides.



cannot we make them Active/Active and teamed up if they are connected to 2 different Storage Switches ?

Again depends on switch support and configuration. e.g. to put this in context, two basic HPE 1810-24G will not supported this, but two HPE 5500 will, in stack mode, and master/secondary.

So difficult to give clear answer on hypothetical switches.

Storage networks are built on the hardware available of

1. storage switches (or switches)
2. vendor SAN

e.g. NetApp will want difference configuration to EMC, Equallogic etc

We have clients with many mixed SAN vendors, and different designs are required for all. One single design does not work for all.

Which means, you have to undersrtand the different requirements for all physical switches, and SANs.
0
jskfanAuthor Commented:
I thought Vmkenel for storage needs to be in a separate subnet  and configured with Default Gateway. Or it Does not ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Why do you think it requires a default gateway?

What is a default gateway and what does it do?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Why do you think Storage VMKernel needs to be in a separate subnet ?
0
jskfanAuthor Commented:
regarding Nic7 and Nic 8, I am trying to undersand how you can make Vmkernel for storage highly available, if one Nic is down the other Nic will be functional, if one storage switch is down the other will be functional.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
you'll understand better if I ask you some questions as your Teacher.

And then in the future be able to apply the knowledge you have learnt.

If I just answer blindly you will not learn.

I think there is some confusion here.

Your last question is fully covered, step by step tutorial with screenshots, in this article I wrote, many years ago for EE but still very valid for 5.5.

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0
0
jskfanAuthor Commented:
in the link above, there is an IP address/DG for :VMkernel iSCSI Portgroup 1
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
there is indeed.....

is it needed ?

what does a default gateway do ?

and why is it there ?

and why is it greyed out ?

and did I type it in ?
0
jskfanAuthor Commented:
what does a default gateway do ?

in the case the source and destination hosts are in the same subnet. DG is not needed... it is used in case Routing is Needed
0
jskfanAuthor Commented:
However Vmkernel has an IP address and storage device has an IP address.
if they are both in the same subnet, then DG is not needed.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
in the case the source and destination hosts are in the same subnet. DG is not needed... it is used in case Routing is Needed

correct

However Vmkernel has an IP address and storage device has an IP address.
if they are both in the same subnet, then DG is not needed.

correct

In fact the IP Address which is filled in grey, is actually added because it's the default IP Address of the Management Network (ESXi quirk).

Generally it's not recommended to route iSCSI Packets, and not a very good idea, to have your iSCSI SAN placed, on a network which it has to be routed to, because of router latency added on to existing network latency, resulting in poor iSCSI performance.
1
jskfanAuthor Commented:
is Vmkernel for Storage the same as Vmkernel for vmotion and Vmkernel for Management ?
I mean you do not need to specify DG , or as you stated it got filled in automatically and greyed out ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
All service ports, special ports required by the Host, are VMKernel Portgroups.

They are different in your enable a VMKernel Portgroup for vMotion or Management by ticking a box.

You only need to specify a Default Gateway if you need one!
0
jskfanAuthor Commented:
You only need to specify a Default Gateway if you need one!

in this case we should already have prepared a specific Vlan on the Switch  just for vmotion. ?and on ESX when we create Vmkernel we assign it an IP address on the same subnet as the Vlan we created ?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
if you want to use VLANs dedicated for vMotion to reduce physical networking- yes!

What is important is not the IP Address, but you must allocate the same Tag number used on the physical switch on the VMKernel Portgroup.

a VLAN is just a VLAN with a number, it does not have an IP Address assigned to it... it can be any IP Address subnet, you run through that VLAN.

But it makes sense to use a different IP Address which is not in use through your network.

IF you are going to do stuff with that IP Address in that VLAN, like Inter-VLAN routing, then you may need to configure additional networking stuff. and tell the switch what IP Address - that VLAN is...
1

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
jskfanAuthor Commented:
Thank you
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.