Cant add iSCSI device to VMWare ESXi 4.1 ...

trevsoft
trevsoft used Ask the Experts™
on
Hi Experts,

I seem to be having a problem adding a iSCSI target via ESXi 4.1.

First of all, let me explain my hardware.

1x Supermicro 8x hot swap bay chassis with Intel motherboard and Adaptec 3805 8 port SAS RAID Controller (1x SSD (FreeNAS 8 installed), 1x 500Gb ISO drive, 2x Array 2Tb (RAID 5EE)).
3x Intel s2625 server chassis with Intel  motherboard, Intel dual 6 core CPU's, 32gb Ram, Intel RAID RS2BL080 Controller, 4x 500Gb RAID 5 Array.

The 3x Intel servers connect to the supermicro (Shared SAN Storage, operating system is FreeNAS 8) system as a iSCSI Target utilising shared storage so we can run total VMware HA, vMotion and DRS.

We have successfully created the FreeNAS server and can connect to it from the VMWare ESXi 4.1 servers using the 500GB ISO drive so we can have one place to store all our ISO files.

Under "Storage Adapters" on the ESXi Configuration tab, we have configured the iSCSI adapter and can successfully see all 3 LUNs/Partitions running on the FreeNAS server (1x 500gb, 2x 2Tb LUNs).

Under "Storage" on the ESXi Configuration tab, we successfully added the 500Gb LUN/partition to ESXi and can see the ISO files and folders we created. This drive is not connected to any RAID controller, its is connected to a SATA port on the motherboard.

This is where is fails ...

Under "Storage" on the ESXi Configuration tab, we can see both 1x array (2Tb). We select the first one and go next we get this error:

Call "HostDatastoreSystem.QueryVmfsDatastoreCreateOptions" for object "datastoreSystem-298" on vCenter Server "vcs1.domain.net.au" failed.

I cant seem to get past this error.

Now my observations ... I think this is having an issue with the RAID or the RAID controller. because the 500Gb ISO drive is not part of a RAID set and the VMWare ESXi servers dont have a problem connecting to this hard drive even though it resides within the same FreeNAS 8 server.

Your help would be appreciated and thank you in advance :)


Trevor
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Danny McDanielClinical Systems Analyst

Commented:
are the larger luns exactly 2TB or 1.99TB?  VMware needs a little bit of space at the end of the LUN so if they are larger than 2tb-512b then ESX(i) won't add the LUN's.

Author

Commented:
Hi Danm66,

I will delete the RAID arrays and make them 1.95Tb would that be enough space ?



Trevor

Author

Commented:
Do we know how much space we need to leave?

Like that we can get the maximum space out of the drives.


Trev
How to Generate Services Revenue the Easiest Way

This Tuesday! Learn key insights about modern cyber protection services & gain practical strategies to skyrocket business:

- What it takes to build a cloud service portfolio
- How to determine which services will help your unique business grow
- Various use-cases and examples

Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
LUNs cannot be above 2TB-512 bytes for the VMFS datastore as per this document.

Configuration Maximums for VMware vSphere 4.1
http://www.vmware.com/pdf/vsphere4/r41/vsp_41_config_max.pdf

If thre 500GB iSCSI LUN is working correctly, it must be the size of the 2TB LUNs which is the issue, but to be honest with you FreeNAS 8 is a mess, in my opinion, and very buggy. (unlike the previous versions that share it's name FreeNAS 0,7, but bare no resemblance any more to the project).

Author

Commented:
Hi,

Yes i understand, but i found its the only way of creating TB's of space with the huge over head of EMC SAN's and the necessary switching equipment required.

Ok here is an interesting one, on both servers i can see the 500Gb drive. But only one can mount it im not getting this error:

Call "HostStorageSystem.ResolveMultipleUnresolvedVmfsVolumes" for object "storageSystem-336" on vCenter Server "vcs1.domain.net.au" failed.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
what do FreeNas logs state if any?

personally I would either try Openfiler, FreeNas 0.7, Starwind iSCSI or SvSAN.

Author

Commented:
Hi,

I tried OpenFiler, wasnt very easy to use.

FreeNAS 0.7 doesnt support the dual channel intel network cards that im using. I had FreeNAS 0.7.2 working last week.

Starwind iSCSI and SvSAN ive never heard of. Going to look now though.


Trevor

Author

Commented:
unless there is a way to make FreeNAS 0.7.2 work with Intel Network Cards.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
hardware support is based on what is supported in FreeBSD 7.3, which Freenas 0.7.2 is based on, but you must have found an Intel card is not supported by FreeBSD, Intel cards are usually recommended, rather than other buggy card drivers in FreeBSD.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
any errors in the event log?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
on Freenas 8?

Author

Commented:
Where can i get FreeNAS 7.3 from. I couldnt find it anywhere.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
there is no Freenas 7.3, you ve misread, FreeBSD 7.3.

Author

Commented:
Oh ok i got ya now sorry.

So what do you recommend i use FreeBSD and manually setup the iSCSI target.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
if your network card is not supported in Freenas 0.7.2, its unlikely to work with FreeBSD, unless you install or compile the driver separetly.

You could Try OpenE NAS.

Author

Commented:
Yeah these are starting to becopme costly for the storage requirments im look at long term.

I dont understand why with freenas 0.7.2 everything worked like a treat in a 200 dollar desktop computer with a realtek network card.

Now i have gone out and bought a production rack mount server as a storage server, nothing works.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Unfortunately, it appears that later versions of Freenas are buggy and not tested, and the quality of testing builds has not been there for a while. (I'm surprised the realtek card worked well for you, because there are issue with that!).

You could try the following

CryptoNAS (http://cryptonas.org/) - Free
EON (http://sites.google.com/site/eonstorage/, Blog http://eonstorage.blogspot.com/) - Free
EuroNAS (http://euronas.de/web/index.php) - Commercial
FreeNAS (http://www.freenas.org/) - Free
Napp-it (http://www.napp-it.org/) - Free
NASLite (http://www.serverelements.com/naslite.php) - Commercial
NexentaStor (http://www.nexenta.com/) - Commercial (Developer Edition is restricted to 4TB)
Open-E (http://www.open-e.com/) - Commercial (Lite Version is restricted to 2TB)
OpenFiler (http://www.openfiler.com/) - Free (Commercial support is available)
PulsarOS (http://pulsaros.digitalplayground.at/) - Free (?), not released yet
UnRAID (http://www.lime-technology.com) - Commercial (Basic Version is restricted to 3 Drives)
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
I'm currenly having similar issues, old hardware works fine with 0.686 and 0.7.1 of FreeNAS, been using it for years with no issue. But recently purchase new hardware for a new larger NAS project, and 0.686 and 0.7.1 of Freenas do not support hardware, 0.7.2 is non-stable, buggy, not testes, I ssupect because leader Open Source developers left the Freenas project, FreeNAS 8 is just a name, it's nothing like Freenas 0.6/0.7, different product, just using the name.

Personally, Openfiler is a disaster. So we are looking at alternatives.

NexentaStor and Open-E, before we look at SvSAN/Starwind iSCSI VSA which is a VMware Appliance.

Author

Commented:
NexentaStor actually looks quite good, have you tried it before?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Testing now....

Author

Commented:
do you know if it is one 18tb storage server. Or can you run multiple storage servers.

the only reason im ask is because we are look at running eventually 3-4 storage servers and i want to get the right solution.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
FreeNAS and Nexenta is on the performance side very much comparable. NexentaStor is slitghly faster in most of the disciplines.

Do you have a budget?

Author

Commented:
At the moment we are doing testing on vmware HA and vmotion. We are trying to stick with the Intel platform as in the past we have found it to be the most compatible until now.

We havent really cut any corners, i just want to try this type of solution before we go down the road of fibre channel hardware which we all know is very expensive just for testing.

I want to really try and stick to something open source and in development so there are furture updates. I dont really want to go with anything proprietory as it becomes costly.

What kind of server are you trying to install it on?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
as for your issue with FreeNas, you may have proved the following

Currently FreeNAS is limited to one LUN in the target because of a technical reason.

https://sourceforge.net/apps/phpbb/freenas/viewtopic.php?f=53&t=6266
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay, because if you had a budget to purchase a commercial solution I would recommend HP Lefthand VSA.

Author

Commented:
Yeah im not much of a HP fan, i prefer IBM, but trying to setup a solution like this with IBM gear. I might as well give up already.

Author

Commented:
I was actually creating a target per LUN.

But i wanted to access the LUN from 3 servers for Fault Tolerance and vMotion in vmware.

Author

Commented:
is there is price tag on HP Lefthand VSA?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
The HP VSA is just software, that they acquired from Lefthand.

Yes, I think that is the issue Freenas does not support multiple hosts per LUN. Seems poor as an iSCSI SAN.

Author

Commented:
Yeah now i know that FreeNAS has an issue with multiple LUN's, i think time to try something else.

So your trying NexentaStor at the moment?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Yes, since the disaster with Freenas.

Author

Commented:
Ok,

Well I had a look into HP lefthand VSA. Even though it looks good. It requires another VMWare license as it's only a appliance.

I think imaging to try the nextastor a good too today. Have you had much luck with it?
VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017
Commented:
early stages of testing, got issues with broadcoam Nics at present and driver faults, so switching to Intel.

VSA is an appliance but a very good one, and ZERO point of failure with clustered mirrored VSAs. We completed 4 way RAiD 10 LUNs, problem with any SAN is always the single point of failure, but if you have the local storage on your ESX servers, you just redistribute as virtual storage. Other than the new vSphere 5.0 VSA, nothing to compete with it.

Author

Commented:
Ok I understand it better. Instead of buying a dedicated storage server just use VSA to create the San on local storage.

Much better use of 6 hot swap bays I say.

Author

Commented:
I'll install it today and if it works with my hardware. Then I'll let you know what specs I have.

Author

Commented:
I'll install it today and if it works with my hardware. Then I'll let you know what specs I have.

Author

Commented:
Hi,

Just letting you know i evaluated about 5 different SAN products, i ended up going with Open-E, i found it to be the best solution.

Also, i had it setup in 15 mins, was very straight forward.



Trevor

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial