Avatar of Trevor Mifsud
Trevor Mifsud
 asked on

Cant add iSCSI device to VMWare ESXi 4.1 ...

Hi Experts,

I seem to be having a problem adding a iSCSI target via ESXi 4.1.

First of all, let me explain my hardware.

1x Supermicro 8x hot swap bay chassis with Intel motherboard and Adaptec 3805 8 port SAS RAID Controller (1x SSD (FreeNAS 8 installed), 1x 500Gb ISO drive, 2x Array 2Tb (RAID 5EE)).
3x Intel s2625 server chassis with Intel  motherboard, Intel dual 6 core CPU's, 32gb Ram, Intel RAID RS2BL080 Controller, 4x 500Gb RAID 5 Array.

The 3x Intel servers connect to the supermicro (Shared SAN Storage, operating system is FreeNAS 8) system as a iSCSI Target utilising shared storage so we can run total VMware HA, vMotion and DRS.

We have successfully created the FreeNAS server and can connect to it from the VMWare ESXi 4.1 servers using the 500GB ISO drive so we can have one place to store all our ISO files.

Under "Storage Adapters" on the ESXi Configuration tab, we have configured the iSCSI adapter and can successfully see all 3 LUNs/Partitions running on the FreeNAS server (1x 500gb, 2x 2Tb LUNs).

Under "Storage" on the ESXi Configuration tab, we successfully added the 500Gb LUN/partition to ESXi and can see the ISO files and folders we created. This drive is not connected to any RAID controller, its is connected to a SATA port on the motherboard.

This is where is fails ...

Under "Storage" on the ESXi Configuration tab, we can see both 1x array (2Tb). We select the first one and go next we get this error:

Call "HostDatastoreSystem.QueryVmfsDatastoreCreateOptions" for object "datastoreSystem-298" on vCenter Server "vcs1.domain.net.au" failed.

I cant seem to get past this error.

Now my observations ... I think this is having an issue with the RAID or the RAID controller. because the 500Gb ISO drive is not part of a RAID set and the VMWare ESXi servers dont have a problem connecting to this hard drive even though it resides within the same FreeNAS 8 server.

Your help would be appreciated and thank you in advance :)


Trevor
VMwareVirtualizationStorage

Avatar of undefined
Last Comment
Trevor Mifsud

8/22/2022 - Mon
Danny McDaniel

are the larger luns exactly 2TB or 1.99TB?  VMware needs a little bit of space at the end of the LUN so if they are larger than 2tb-512b then ESX(i) won't add the LUN's.
Trevor Mifsud

ASKER
Hi Danm66,

I will delete the RAID arrays and make them 1.95Tb would that be enough space ?



Trevor
Trevor Mifsud

ASKER
Do we know how much space we need to leave?

Like that we can get the maximum space out of the drives.


Trev
Experts Exchange is like having an extremely knowledgeable team sitting and waiting for your call. Couldn't do my job half as well as I do without it!
James Murphy
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

LUNs cannot be above 2TB-512 bytes for the VMFS datastore as per this document.

Configuration Maximums for VMware vSphere 4.1
http://www.vmware.com/pdf/vsphere4/r41/vsp_41_config_max.pdf

If thre 500GB iSCSI LUN is working correctly, it must be the size of the 2TB LUNs which is the issue, but to be honest with you FreeNAS 8 is a mess, in my opinion, and very buggy. (unlike the previous versions that share it's name FreeNAS 0,7, but bare no resemblance any more to the project).
Trevor Mifsud

ASKER
Hi,

Yes i understand, but i found its the only way of creating TB's of space with the huge over head of EMC SAN's and the necessary switching equipment required.

Ok here is an interesting one, on both servers i can see the 500Gb drive. But only one can mount it im not getting this error:

Call "HostStorageSystem.ResolveMultipleUnresolvedVmfsVolumes" for object "storageSystem-336" on vCenter Server "vcs1.domain.net.au" failed.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

what do FreeNas logs state if any?

personally I would either try Openfiler, FreeNas 0.7, Starwind iSCSI or SvSAN.
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Trevor Mifsud

ASKER
Hi,

I tried OpenFiler, wasnt very easy to use.

FreeNAS 0.7 doesnt support the dual channel intel network cards that im using. I had FreeNAS 0.7.2 working last week.

Starwind iSCSI and SvSAN ive never heard of. Going to look now though.


Trevor
Trevor Mifsud

ASKER
unless there is a way to make FreeNAS 0.7.2 work with Intel Network Cards.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

hardware support is based on what is supported in FreeBSD 7.3, which Freenas 0.7.2 is based on, but you must have found an Intel card is not supported by FreeBSD, Intel cards are usually recommended, rather than other buggy card drivers in FreeBSD.
Your help has saved me hundreds of hours of internet surfing.
fblack61
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

any errors in the event log?
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

on Freenas 8?
Trevor Mifsud

ASKER
Where can i get FreeNAS 7.3 from. I couldnt find it anywhere.
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

there is no Freenas 7.3, you ve misread, FreeBSD 7.3.
Trevor Mifsud

ASKER
Oh ok i got ya now sorry.

So what do you recommend i use FreeBSD and manually setup the iSCSI target.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

if your network card is not supported in Freenas 0.7.2, its unlikely to work with FreeBSD, unless you install or compile the driver separetly.

You could Try OpenE NAS.
This is the best money I have ever spent. I cannot not tell you how many times these folks have saved my bacon. I learn so much from the contributors.
rwheeler23
Trevor Mifsud

ASKER
Yeah these are starting to becopme costly for the storage requirments im look at long term.

I dont understand why with freenas 0.7.2 everything worked like a treat in a 200 dollar desktop computer with a realtek network card.

Now i have gone out and bought a production rack mount server as a storage server, nothing works.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Unfortunately, it appears that later versions of Freenas are buggy and not tested, and the quality of testing builds has not been there for a while. (I'm surprised the realtek card worked well for you, because there are issue with that!).

You could try the following

CryptoNAS (http://cryptonas.org/) - Free
EON (http://sites.google.com/site/eonstorage/, Blog http://eonstorage.blogspot.com/) - Free
EuroNAS (http://euronas.de/web/index.php) - Commercial
FreeNAS (http://www.freenas.org/) - Free
Napp-it (http://www.napp-it.org/) - Free
NASLite (http://www.serverelements.com/naslite.php) - Commercial
NexentaStor (http://www.nexenta.com/) - Commercial (Developer Edition is restricted to 4TB)
Open-E (http://www.open-e.com/) - Commercial (Lite Version is restricted to 2TB)
OpenFiler (http://www.openfiler.com/) - Free (Commercial support is available)
PulsarOS (http://pulsaros.digitalplayground.at/) - Free (?), not released yet
UnRAID (http://www.lime-technology.com) - Commercial (Basic Version is restricted to 3 Drives)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

I'm currenly having similar issues, old hardware works fine with 0.686 and 0.7.1 of FreeNAS, been using it for years with no issue. But recently purchase new hardware for a new larger NAS project, and 0.686 and 0.7.1 of Freenas do not support hardware, 0.7.2 is non-stable, buggy, not testes, I ssupect because leader Open Source developers left the Freenas project, FreeNAS 8 is just a name, it's nothing like Freenas 0.6/0.7, different product, just using the name.

Personally, Openfiler is a disaster. So we are looking at alternatives.

NexentaStor and Open-E, before we look at SvSAN/Starwind iSCSI VSA which is a VMware Appliance.
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Trevor Mifsud

ASKER
NexentaStor actually looks quite good, have you tried it before?
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Testing now....
Trevor Mifsud

ASKER
do you know if it is one 18tb storage server. Or can you run multiple storage servers.

the only reason im ask is because we are look at running eventually 3-4 storage servers and i want to get the right solution.
I started with Experts Exchange in 2004 and it's been a mainstay of my professional computing life since. It helped me launch a career as a programmer / Oracle data analyst
William Peck
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

FreeNAS and Nexenta is on the performance side very much comparable. NexentaStor is slitghly faster in most of the disciplines.

Do you have a budget?
Trevor Mifsud

ASKER
At the moment we are doing testing on vmware HA and vmotion. We are trying to stick with the Intel platform as in the past we have found it to be the most compatible until now.

We havent really cut any corners, i just want to try this type of solution before we go down the road of fibre channel hardware which we all know is very expensive just for testing.

I want to really try and stick to something open source and in development so there are furture updates. I dont really want to go with anything proprietory as it becomes costly.

What kind of server are you trying to install it on?
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

as for your issue with FreeNas, you may have proved the following

Currently FreeNAS is limited to one LUN in the target because of a technical reason.

https://sourceforge.net/apps/phpbb/freenas/viewtopic.php?f=53&t=6266
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

okay, because if you had a budget to purchase a commercial solution I would recommend HP Lefthand VSA.
Trevor Mifsud

ASKER
Yeah im not much of a HP fan, i prefer IBM, but trying to setup a solution like this with IBM gear. I might as well give up already.
Trevor Mifsud

ASKER
I was actually creating a target per LUN.

But i wanted to access the LUN from 3 servers for Fault Tolerance and vMotion in vmware.
Experts Exchange has (a) saved my job multiple times, (b) saved me hours, days, and even weeks of work, and often (c) makes me look like a superhero! This place is MAGIC!
Walt Forbes
Trevor Mifsud

ASKER
is there is price tag on HP Lefthand VSA?
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

The HP VSA is just software, that they acquired from Lefthand.

Yes, I think that is the issue Freenas does not support multiple hosts per LUN. Seems poor as an iSCSI SAN.
Trevor Mifsud

ASKER
Yeah now i know that FreeNAS has an issue with multiple LUN's, i think time to try something else.

So your trying NexentaStor at the moment?
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Yes, since the disaster with Freenas.
Trevor Mifsud

ASKER
Ok,

Well I had a look into HP lefthand VSA. Even though it looks good. It requires another VMWare license as it's only a appliance.

I think imaging to try the nextastor a good too today. Have you had much luck with it?
ASKER CERTIFIED SOLUTION
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Log in or sign up to see answer
Become an EE member today7-DAY FREE TRIAL
Members can start a 7-Day Free trial then enjoy unlimited access to the platform
Sign up - Free for 7 days
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.
Not exactly the question you had in mind?
Sign up for an EE membership and get your own personalized solution. With an EE membership, you can ask unlimited troubleshooting, research, or opinion questions.
ask a question
Trevor Mifsud

ASKER
Ok I understand it better. Instead of buying a dedicated storage server just use VSA to create the San on local storage.

Much better use of 6 hot swap bays I say.
All of life is about relationships, and EE has made a viirtual community a real community. It lifts everyone's boat
William Peck
Trevor Mifsud

ASKER
I'll install it today and if it works with my hardware. Then I'll let you know what specs I have.
Trevor Mifsud

ASKER
I'll install it today and if it works with my hardware. Then I'll let you know what specs I have.
Trevor Mifsud

ASKER
Hi,

Just letting you know i evaluated about 5 different SAN products, i ended up going with Open-E, i found it to be the best solution.

Also, i had it setup in 15 mins, was very straight forward.



Trevor
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.