Link to home
Start Free TrialLog in
Avatar of Zvezda Z
Zvezda Z

asked on

This configuration will delete the current disk layout.

Hi, I have two ESXi servers. Each ESXi server has its own datastore (on which it is installed) and each ESXi server is connected to external datastores (where the virtual machines are stored).
After reinstalling one of the servers, I can't assign external datastores to it without formatting. On the ESXi that is not reinstalled, everything works fine.
Please check the following images for more info. Thank you.
Capture2.JPG
Capture3.JPG
Capture4.JPG
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
So just to summarise the LUNs are presented to the hosts but the datastore are not listed?

Do you have access to the hosts console or remotely via SSH.
Avatar of Zvezda Z
Zvezda Z

ASKER

I cannot add datastore to the server without formatting. The host "sees" the datastores, if that is your question. I have ssh access to it, and I have tried esxcfg-volume -l , but nothing showed up on the reinstalled server, neither on the host that runs correctly.
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
Okay time to look at the logs and check the error messages for why it cannot mount the datastore.

It will be stated.
Avatar of Zvezda Z
Zvezda Z

ASKER

[root@esxi2:~] less /var/log/vmkernel.log

2015-10-18T12:53:12.461Z cpu16:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T12:56:42.463Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T12:56:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:01:42.462Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:01:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:06:42.461Z cpu20:84788)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:06:42.462Z cpu20:84788)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:11:42.462Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:11:42.464Z cpu3:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:16:42.462Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:16:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:21:42.462Z cpu5:85428)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:21:42.463Z cpu5:85428)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:22:26.988Z cpu12:74361)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T13:22:26.988Z cpu12:74361)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c21c00, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T13:22:26.988Z cpu12:33238)ScsiDeviceIO: 2645: Cmd(0x439dc0c21c00) 0x4d, CmdSN 0x6a from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T13:23:12.461Z cpu30:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T13:26:42.462Z cpu18:85205)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:26:42.463Z cpu16:85205)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:31:42.461Z cpu21:85876)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:31:42.462Z cpu21:85876)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:36:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:36:42.465Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:41:42.462Z cpu25:86295)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:41:42.463Z cpu25:86295)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:46:42.462Z cpu8:86489)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:46:42.463Z cpu8:86489)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:51:42.462Z cpu22:85876)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:51:42.463Z cpu22:85876)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T13:52:27.004Z cpu12:33424)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T13:52:27.004Z cpu6:32809)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c6a500, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T13:52:27.004Z cpu6:32809)ScsiDeviceIO: 2645: Cmd(0x439dc0c6a500) 0x4d, CmdSN 0x6d from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T13:53:12.459Z cpu16:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T13:56:42.462Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T13:56:42.463Z cpu10:33077)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:01:42.462Z cpu20:86711)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:01:42.463Z cpu20:86711)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:06:42.463Z cpu26:87480)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:06:42.464Z cpu26:87480)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:11:42.462Z cpu4:87103)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:11:42.463Z cpu2:87103)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:16:42.462Z cpu16:86295)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:16:42.463Z cpu16:86295)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:21:42.462Z cpu25:87703)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:21:42.463Z cpu25:87703)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:22:27.020Z cpu12:33166)<4>hpsa 0000:02:00.0: Device:C1:B0:T0:L1 Command:0x85 CC:05/20/00 Illegal Request.
2015-10-18T14:22:27.020Z cpu8:33130)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x85 (0x439dc0c0cd00, 34463) to dev "naa.600508b1001c59a59844741740dadc3f" on path "vmhba0:C0:T0:L1" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2015-10-18T14:22:27.020Z cpu8:33130)ScsiDeviceIO: 2645: Cmd(0x439dc0c0cd00) 0x4d, CmdSN 0x70 from world 34463 to dev "naa.600508b1001c59a59844741740dadc3f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2015-10-18T14:23:12.459Z cpu18:33392)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device naa.600508b1001c59a59844741740dadc3f repeated 1 times
2015-10-18T14:26:42.462Z cpu12:86906)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:26:42.463Z cpu12:86906)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x11
2015-10-18T14:31:42.462Z cpu24:88547)ScsiScan: 836: Path vmhba2:C0:T0:L0 supports REPORT LUNS 0x11
2015-10-18T14:31:42.463Z cpu24:88547)ScsiScan: 836: Path vmhba2:C0:T1:L0 supports REPORT LUNS 0x1
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
Okay so this was an ESXi Server that was connected to these external LUNs

What storage are the LUNs on...

Is this FC or iSCSI ?

After you reinstalled ESXi did you make any changes eg assign IQN or WWNN  assign permissions to LUNs.
Avatar of Zvezda Z
Zvezda Z

ASKER

Yeah, this is the server that was connected to LUNs.
This is iSCSI. Nothing is changed to the permissions of LUNs.
What do you mean by "What storage are the LUNs on..." ? We are using HP P200 as storage.
Avatar of Zvezda Z
Zvezda Z

ASKER

I checked again P2000 G3 storage, and it is using  SAS controllers for communication with servers, 2 installed. I'm  sorry for giving you wrong info. Detailed specs about P2000 can be found here: http://www8.hp.com/h20195/v2/GetPDF.aspx/c04168365.pdf
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
okay, same applies, you will need to check if the LUNs, have been granted permissions to the SAS controllers.
Avatar of Zvezda Z
Zvezda Z

ASKER

OK, but how can I do that?
Avatar of Zvezda Z
Zvezda Z

ASKER

I've noticed something else. It seems that troubled server kept symbolic links, but it couldn't find folders that are pointed by these symbolic links. Does this mean anything to you? Please see attached.
valid-server.jpg
troubled-server.jpg
Avatar of Zvezda Z
Zvezda Z

ASKER

Datastores are visible all the time, I just cannot mount it without wiping all data.
Please see all steps for adding datastores. However, I did rescaning of the datastores. Also, I've rebooted server. Nothing helps.
add-storage-1.JPG
add-storage-2.JPG
add-storage-3.JPG
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
The LUNs are present, but your datastores should be auto mounting when they are discovered by the hiost.

You only use the Add Datastores options to create new datastores.

This option should really be called "Add New Datastores.".

can you upload the entire vmkernel.log  or you could tail the log, and refresh the HBAs and see if there are any errors.
Avatar of Zvezda Z
Zvezda Z

ASKER

Andrew,

Please see full tailed log file attached, after refreshing of HBAs :
log.txt
ASKER CERTIFIED SOLUTION
Avatar of Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)
Flag of United Kingdom of Great Britain and Northern Ireland image
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of Zvezda Z
Zvezda Z

ASKER

Andrew,
after you pointed me on ATS suppourt and VAAI plugins, I  tried to install old ESXi 5.0 (HP 5.21.17 version, first one that i installed on those servers, have VAAI plugins included on ISO) and after installation both of the datastores showed up! After that, I installed 6.0 U1 update and now both servers are working fine.

Thank you very much for your help!