ESXi 5.5 and iSCSI

I am redoing our lab and our replacement lab servers use a Broadcom NetXtreem II BCM5709 Network cards. From what I have read only they support iSCSI and should be about to set the IP in the NIC's BIOS.

I have read Hancock's article on how to setup software iSCSI but I have a couple of questions on hardware iSCSI since I use much more.

Once I add the target IP in the NIC's BIOS and ESXi boots do I just need to rescan for the lun to show? I have nothing nlisted under storage adapters for iSCSI though..

I know basic question .... ;-)
LVL 21
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Yes, this is correct Hardware iSCSI HBA, or ToE cards, are very similar to FC HBAs, very little configuration is required, other than configuration at the iSCSI HBA BIOS level.

and yes, just issues a re-scan on the HBA, and the LUNs should appear!

Just make sure, once again, you add the IQN (equivalent of the Fibre Channel HBA WWNN) to the iSCSI LUN Access Control List, or Mapping on the iSCSI SAN, otherwise no LUN will be accessed.

Many iSCSI HBA BIOS allow you to detect the LUNs, at the BIOS screen "outside" of ESXi, but of course when your initially BOOT the server.

You may want to do so tests, because in our experience, Hardware HBAs, could never support Jumbo Frames, e.g. MTU approx 9,000.

and we found, that the ESXi iSCSI Software Adaptor, and Jumbo Frames (MTU 9000) out performed Hardware iSCSI HBA (without jumbo frames, because not supported).

In our experience.... this was blogged about somewhere on the net in the passed and confirmed!

here is the reference...

So, for many years, since approx 2004, we advised clients to stop purchasing/using hardware iSCSI HBAs, as iSCSI networking is supposed to be cheaper than FC, otherwise you might as well purchase two FC HBA per server!

there was always a through that iSCSI, had a huge CPU overhead in the host, converting SCSI to network packets, and decoding, but as CPU have become faster, and faster in the hosts, this issue does not seem to an issue.

Unless you have seen otherwise.....(or been advised otherwise!)
compdigit44Author Commented:
Great response!!!

Now I notice we I set the IP in the BIOS with the proper subnet I am not able to ping it from another workstation. Also for my storage server I am using an Windows 2012 r2 server with an attached MSA70 as an iscsi target
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Windows 2012 R2 Server with a MSA70 - okay, so not exactly lightening fast storage!

I thought maybe you had purchased a new  Tegile Systems 500TB All Flash Array!
Protecting & Securing Your Critical Data

Considering 93 percent of companies file for bankruptcy within 12 months of a disaster that blocked access to their data for 10 days or more, planning for the worst is just smart business. Learn how Acronis Backup integrates security at every stage

compdigit44Author Commented:
LOL... I wish I had a flash array but lab enviroments are what is ever left over before it goes out the door.

Anyway. On the broadcom NIC I set their IP's in the NIC BIOS, configured the WINDOW 2012 storage server with the IP for the initators and when I do a storage rescan it is not seeing anything.

When I goes under Strorage Adapters I see 8 iSCSI adapter listed under the broadcom. I can right click each adapter and and set thing like static or dynamic discovery. Do I still need to do this.

Also even though I set the IP in the BIOS should I be able to ping it becuase right now I cannot and confirmed I do have link
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
EDIT:- Just re-read question... Broadcom NetXtreem II BCM5709 Network cards - these required special attention! and it's painful! (not as simple as it should be!)

Yes, you still need to configure in ESXi, with an IP Address.

You should be able to view the LUNs at the BIOS level, to confirm you have access to the SAN.

Ah, now you mention you have Broadcom NICs, now these could be slightly different, do you know if these are dedicated iSCSI HBAs or do they share iSCSI and Network interfaces ?

e.g. what is the server...e.g. our Dell Servers have Broadcom iSCSI Adaptors, and also Network Interfaces, which are shared.....and these require a different procedure to be set up, as they are a hybrid HBA/NIC, not a dedicated iSCSI HBA, like a Qlogic QA4060, which is just a HBA, not a nIc!

Any reason why you are not using Software iSCSI Adaptor ?
compdigit44Author Commented:
Thanks for the reply....

my manage NIC and ISCSI NIC are separate. I am not using software iscsi since the NIC support this. The older servers are IBM x3850 M3's
compdigit44Author Commented:
I also noticed under static and dynamic discovery I do not have the option to add my target IP. Also under network configuration it looks like it want to bind to a nic but have not nic's listed to choose from
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Yes, the nics support it with much configuration!

let me find a reference...
compdigit44Author Commented:
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
compdigit44Author Commented:
Thanks I am going to give it a try... If I cannot get it to work I will try software iscsi...

I will keep you posted.
compdigit44Author Commented:
OK so I am a bit confused reading this article and mind you the host are running ESXi 5.5. Do I still need to setup a software iscsi adapter even thought I am trying to use the iscsi function of the NIC card?
compdigit44Author Commented:
Also after I configure the IP in the NIC BIOS, should I be able to ping it on the network? If so I cannot..
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Ah! with these hybrid HBA/NICs not necessarily.

with a full iSCSI HBA - yes, but these are not that!
compdigit44Author Commented:
Good to know... Wow I am learning a lot about ISCSI here .. I am so use to using FC...

I am still a bit confused on the article...

 Do I still need to setup Software iscsi or not? I am using 5.5
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Unless you want to use iSCSI Software Adaptor, no requirement to set it up.

Use the 5.0 reference, not the 4.1, 4.1 and 5.x are very different.

should be using this guide...(but I could not find the refers to, let me look further!)
compdigit44Author Commented:
I will try it tomorrow and keep you posted...
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
the adaptor, needs to be bound to iSCSI.

here is a URL with guidance

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
compdigit44Author Commented:
This was an amazing article and learned so much from it!!!! I though setting up a hardware iscsi card would be easier but it is not
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
I did tell you!

Proper Hardware iSCSI adaptors are easy, but these cheapo hybrid ones, are long winded!
compdigit44Author Commented:
thank you so much...  you are a great help as always.... :-)
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today

From novice to tech pro — start learning today.