This configuration will delete the current disk layout.

Hi, I have two ESXi servers. Each ESXi server has its own datastore (on which it is installed) and each ESXi server is connected to external datastores (where the virtual machines are stored).
After reinstalling one of the servers, I can't assign external datastores to it without formatting. On the ESXi that is not reinstalled, everything works fine.
Please check the following images for more info. Thank you.
Capture2.JPG
Capture3.JPG
Capture4.JPG
Zvezda ZAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
So just to summarise the LUNs are presented to the hosts but the datastore are not listed?

Do you have access to the hosts console or remotely via SSH.
1
Zvezda ZAuthor Commented:
I cannot add datastore to the server without formatting. The host "sees" the datastores, if that is your question. I have ssh access to it, and I have tried esxcfg-volume -l , but nothing showed up on the reinstalled server, neither on the host that runs correctly.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Okay time to look at the logs and check the error messages for why it cannot mount the datastore.

It will be stated.
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

Zvezda ZAuthor Commented:
[root@esxi2:~] less /var/log/vmkernel.log

2015-10-18T12:53:12.461Z cpu16:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T12:56:42.463Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T12:56:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:01:42.462Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:01:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:06:42.461Z cpu20:84788)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:06:42.462Z cpu20:84788)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:11:42.462Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:11:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:16:42.462Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:16:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:21:42.462Z cpu5:85428)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:21:42.463Z cpu5:85428)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:22:26.988Z cpu12:74361)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T13:22:26.988Z cpu12:74361)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c21c00, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T13:22:26.988Z cpu12:33238)ScsiDeviceIO: 2645: Cmd(0x439dc0c21c00) 0x4d, CmdSN 0x6a from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T13:23:12.461Z cpu30:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T13:26:42.462Z cpu18:85205)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:26:42.463Z cpu16:85205)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:31:42.461Z cpu21:85876)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:31:42.462Z cpu21:85876)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:36:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:36:42.465Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:41:42.462Z cpu25:86295)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:41:42.463Z cpu25:86295)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:46:42.462Z cpu8:86489)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:46:42.463Z cpu8:86489)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:51:42.462Z cpu22:85876)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:51:42.463Z cpu22:85876)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:52:27.004Z cpu12:33424)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T13:52:27.004Z cpu6:32809)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c6a500, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T13:52:27.004Z cpu6:32809)ScsiDeviceIO: 2645: Cmd(0x439dc0c6a500) 0x4d, CmdSN 0x6d from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T13:53:12.459Z cpu16:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T13:56:42.462Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:56:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:01:42.462Z cpu20:86711)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:01:42.463Z cpu20:86711)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:06:42.463Z cpu26:87480)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:06:42.464Z cpu26:87480)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:11:42.462Z cpu4:87103)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:11:42.463Z cpu2:87103)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:16:42.462Z cpu16:86295)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:16:42.463Z cpu16:86295)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:21:42.462Z cpu25:87703)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:21:42.463Z cpu25:87703)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:22:27.020Z cpu12:33166)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T14:22:27.020Z cpu8:33130)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c0cd00, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T14:22:27.020Z cpu8:33130)ScsiDeviceIO: 2645: Cmd(0x439dc0c0cd00) 0x4d, CmdSN 0x70 from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T14:23:12.459Z cpu18:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T14:26:42.462Z cpu12:86906)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:26:42.463Z cpu12:86906)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:31:42.462Z cpu24:88547)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:31:42.463Z cpu24:88547)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x1
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Okay so this was an ESXi Server that was connected to these external LUNs

What storage are the LUNs on...

Is this FC or iSCSI ?

After you reinstalled ESXi did you make any changes eg assign IQN or WWNN  assign permissions to LUNs.
0
Zvezda ZAuthor Commented:
Yeah, this is the server that was connected to LUNs.
This is iSCSI. Nothing is changed to the permissions of LUNs.
What do you mean by "What storage are the LUNs on..." ? We are using HP P200 as storage.
0
Zvezda ZAuthor Commented:
I checked again P2000 G3 storage, and it is using  SAS controllers for communication with servers, 2 installed. I'm  sorry for giving you wrong info. Detailed specs about P2000 can be found here: http://www8.hp.com/h20195/v2/GetPDF.aspx/c04168365.pdf
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
okay, same applies, you will need to check if the LUNs, have been granted permissions to the SAS controllers.
1
Zvezda ZAuthor Commented:
OK, but how can I do that?
0
Zvezda ZAuthor Commented:
I've noticed something else. It seems that troubled server kept symbolic links, but it couldn't find folders that are pointed by these symbolic links. Does this mean anything to you? Please see attached.
valid-server.jpg
troubled-server.jpg
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
if you Re-scan storage, do they appear ?
0
Zvezda ZAuthor Commented:
Datastores are visible all the time, I just cannot mount it without wiping all data.
Please see all steps for adding datastores. However, I did rescaning of the datastores. Also, I've rebooted server. Nothing helps.
add-storage-1.JPG
add-storage-2.JPG
add-storage-3.JPG
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
The LUNs are present, but your datastores should be auto mounting when they are discovered by the hiost.

You only use the Add Datastores options to create new datastores.

This option should really be called "Add New Datastores.".

can you upload the entire vmkernel.log  or you could tail the log, and refresh the HBAs and see if there are any errors.
1
Zvezda ZAuthor Commented:
Andrew,

Please see full tailed log file attached, after refreshing of HBAs :
log.txt
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
okay, this is because, this new host does not support ATS, and cannot mount an ATS VMFS datastore.

see the logs here

HBX: 2226: ATS-Only VMFS volume 'Storage1' is not mounted. This host does not support ATS, or ATS initialization failed.

see here for resolution and workaround.

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2006858

http://www.virtualizationteam.com/server-virtualization/ats-only-vmfs-volume-vmfs5-not-mounted-host-does-not-support-ats-or-ats-initialization-has-failed.html

Also check, both hosts you have have been setup identically, e.g. ESXi versions, also check VAAI plugins if using them are in both hosts, It could be that you have included VAAI plugins on the hosts before, but they are missing from this new host, if you add them, the issue will be fixed, without doing workarounds above.
1

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Zvezda ZAuthor Commented:
Andrew,
after you pointed me on ATS suppourt and VAAI plugins, I  tried to install old ESXi 5.0 (HP 5.21.17 version, first one that i installed on those servers, have VAAI plugins included on ISO) and after installation both of the datastores showed up! After that, I installed 6.0 U1 update and now both servers are working fine.

Thank you very much for your help!
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
no problems!
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.