Solved

ESXi iSCSI attached store

Posted on 2013-01-19
23
617 Views
Last Modified: 2013-01-27
Hello all,
 I recently has an issue with a Windows Server 2008 Storage Server Standard Edition that forced me to do a Windows repair. In that process I lost some configuration. This Windows server is the data store for 2 ESXi (ESXi 4.1.0) servers. The interface between the 3 servers is iSCSI over ethernet.  After I reconfigured the interfaces back to the original configs everything was fine until I restarted on of the ESXi servers. When the ESXi server came back up it could not see the data store any longer. The second ESXi server is still communicating with the NAS and it still sees the file store it needs. I did not reboot the second ESXi server. Here are the details.

1. The interfaces on the ESXi and NAS are configured as follows.
   A. Iface 1
       * NAS, local lan subnet
       * ESXi, local LAN subnet (management network)

   B. Iface 2
      *NAS, iSCSi -1  10.10.10.1
      *ESXi, iSCSI on vSwitch 10.10.10.11

   C. Iface 3
       *NAS, iSCSI -2 10.10.20.1
       *ESXi, iSCSI on vSwitch 10.10.20.11
   

2. The ESXi server can ping the NAS on all 3 interfaces that are configured.
3. The NAS server can ping the ESXi server on all 3 interfaces that are configured.
4. No configuration changes have been made on the ESXi server.
5. The ESXi server can not auto discover the data store on the NAS.

How can I get this communication back between these two servers to bring this data store back online?
0
Comment
Question by:Brocklv6
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 13
  • 9
23 Comments
 
LVL 120
ID: 38797148
does the ESXi server connect to the iSCSI server?
0
 

Author Comment

by:Brocklv6
ID: 38797155
The ESXi server connects to the NAS over 2 iSCSI over Ethernet interfaces.
0
 
LVL 39

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 167 total points
ID: 38797163
Remove the store on esxi and readd it. Haven't found a better way
0
Forrester Webinar: xMatters Delivers 261% ROI

Guest speaker Dean Davison, Forrester Principal Consultant, explains how a Fortune 500 communication company using xMatters found these results: Achieved a 261% ROI, Experienced $753,280 in net present value benefits over 3 years and Reduced MTTR by 91% for tier 1 incidents.

 
LVL 120
ID: 38797169
so, a single esxi server is missing a datastore?

when you rescan storage devices, is the lun displayed?
0
 

Author Comment

by:Brocklv6
ID: 38797187
This is what I see for devices.

ESXi LUN
0
 
LVL 120
ID: 38797191
under storage adapters
0
 

Author Comment

by:Brocklv6
ID: 38797196
iSCSI LUN
0
 

Author Comment

by:Brocklv6
ID: 38797199
Would it be something with the iSCSI Initiator on the Windows NAS?
0
 
LVL 120
ID: 38797203
check the properties of the iSCSI hba that it has the IP address of the iSCSI server, and if you are using chap settings check these are also correct.

rescan storage device

also check access is correctly allocated to this ESXi server iqn, permissions are correct on lun
0
 

Author Comment

by:Brocklv6
ID: 38797219
Another thing, t2here has been no changes made to the ESXi server. This has to be an issue with a config Windows NAS.
0
 
LVL 120
ID: 38797235
check iSCSI nas configs between servers, it would seem this server does not have access
0
 

Author Comment

by:Brocklv6
ID: 38797340
Seems that he Windows NAS is not listening on port 3260. But I cant find the service to start that uses that port.
0
 

Author Comment

by:Brocklv6
ID: 38797775
Ok, here is the latest update. I was able to re-install a iSCSI Target application on the NAS server, so now the ESXi host can see the storage on the NAS over iSCSI. For some reason I can not ad it as a datastore. Should the ESXi server see this storage now that auto discovery is working? Or do I need to actually add this as a datastore? Attached is the error I am getting. error
 Note: The VM data on this NAS drive is two virtual hard drive that contain all of the data for this ESXi host,  12 virtual machines. drive
0
 
LVL 120
ID: 38798173
that error above is a Windows sharing error.

so you can see the LUN now, but no datastore is visible?
0
 

Author Comment

by:Brocklv6
ID: 38798799
That is correct. When I start to add the datastore is when the error is thrown. I also do not want to format the data store, I want to still attach the existing VMs.
0
 
LVL 120
ID: 38799085
you will need to connect the Host ESX server using SSH, or run these commands at the console

type the following

esxcfg-volume -l

you should get output similar to the following:-

~ # esxcfg-volume -l
VMFS3 UUID/label: 4cc89503-f054d0d4-2865-00221958e471/nas3-vmfs
Can mount: Yes
Can resignature: No (the volume is being actively used)
Extent name: naa.600140588e9bab7d2b7ed4b53dadc1de:1     range: 0 - 1048319 (MB)

and then type

esxcfg-volume -m 4cc89503-f054d0d4-2865-00221958e471

or

esxcfg-volume -m nas3-vmfs

Refresh the displays on vSphere Client
0
 

Author Comment

by:Brocklv6
ID: 38799388
I attached the wrong error screen, this is the correct one. errorAlso, I changed the target connector to attach the partition instead of the physical drive. This is how it was configured before. Would this change the command you posted?3target
0
 
LVL 120

Assisted Solution

by:Andrew Hancock (VMware vExpert / EE MVE^2)
Andrew Hancock (VMware vExpert / EE MVE^2) earned 333 total points
ID: 38799416
iSCSI disk looks blank?

overwritten?

check using command line
0
 

Author Comment

by:Brocklv6
ID: 38799442
No it is not blank. DiskI do not have physical access to the ESXi host and I can not SSH into it because is is not enabled. How can I enable SSH with the vSphere client? Is it enable  VMkernel.Boot.techSupportMode?
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 333 total points
ID: 38799465
when you connected above it states the disk is blank?

there is no vmfs?

SSH and ESXi shell are enabled through the vSphere Client

see here

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1017910
0
 

Author Comment

by:Brocklv6
ID: 38799599
Yes it does show that the disk is blank but that is after it it errors. I know the disk is not blank. The 4 files are the only ones that have ever been present in the partition .vhd and .cbm
0
 

Assisted Solution

by:Brocklv6
Brocklv6 earned 0 total points
ID: 38806530
Solved.!!!
The ESXi server connects to the iSCSI targets on the NAS. After the recovery from the NAS crash the host could see but not mount the data stores. I fixed this by shutting down the iSCSI initiator in the host and renaming the files in /etc/vmware/vmkiscsid to .old. Reboot the host, and restarted the iSCSI initiator. It seemed that the .vhd files were corrupt for some reason. So thankfully I have a decent DR plan in place so I recovered my last backups of the .vhd files. I then rebuilt the iSCSI targets to mount the .vhd files instead of the NAS drive or partition. The host was then able to see and mount the data stores. All of the VMs came up and started successfully. I am having a small issue with the host, if I try to shut down or restart a VM the process will hang on 95%. It almost seems like the swap is full or there is an excessive memory usage. So I have to manually reboot the host to get out of the jam.
0
 

Author Closing Comment

by:Brocklv6
ID: 38823802
With the help form the people at experts-exchange, a VM specialist here locally, and some persistence and research on my part the problem was solved. Than you to all that helped.
0

Featured Post

Space-Age Communications Transitions to DevOps

ViaSat, a global provider of satellite and wireless communications, securely connects businesses, governments, and organizations to the Internet. Learn how ViaSat’s Network Solutions Engineer, drove the transition from a traditional network support to a DevOps-centric model.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Mount cloned RDM in Windows VM without formatting 6 68
DC freezes when running VMTools 15 64
Unable to hit site 2 30
VMWare vSAN 5 30
Most of the applications these days are on Cloud. Cloud is ubiquitous with many service providers in the market. Since it has many benefits such as cost reduction, software updates, remote access, disaster recovery and much more.
When rebooting a vCenters 6.0 and try to connect using vSphere Client we get this issue "Invalid URL: The hostname could not parsed." When we get this error we need to do some changes in the vCenter advanced settings to fix the issue.
This video shows you how to use a vSphere client to connect to your ESX host as the root user. Demonstrates the basic connection of bypassing certification set up. Demonstrates how to access the traditional view to begin managing your virtual mac…
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…

696 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question