Solved

HP MSA disk errors

Posted on 2011-09-28
15
2,332 Views
Last Modified: 2012-05-12
We've been having issues with our HP MSA 2312sawith seeing parity errors plus the enclosure being in a degraded status. I've contacted HP and after updating the firmware on the controllers and hard drives after a verify disk process fails again they want me to run a verify vdisk VHD1  fix yes from the CLI.y understanding is this command will go through and fix the parity issues.  HP recommends backing up everything on the MSA before running this command. If this command just fixes parity is backing up the 1.5 tb worth of VHD's on the MSA necessary before running this process? Additionally HP informed us we needed to stop all I/O to the MSA prior to and during this process. This involves stopping all virtual hyper v guests and hosts and shutting them down. Is this required or just recommended? I tried to get a estimated tome frame for scheduling downtime but HP wasnt much help. The regular verify took about 5 hours befogging retiring out. How long would the fix yes option take? The VDisk is about 1.5 tb with total space on the MSA being about 1.8 tb.
0
Comment
Question by:georgedschneider
15 Comments
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
After weeks of firmware upgrades, console sessions and log downloads back to HP, that was their fix for us, Sorry for the bad news here.

Yes, this is standard HP Support fix, with no understanding of 24x7 Production! (even the on-site Engineers after escalation  to 3rd line HP Storage support were disgusted with the solution!)

We've had issues with customers MSA2324i's with this problems, the verify vdisk takes days and weeks to complete. We had to backup just to be safe, and it was a good job, because the verify causes the virtual disk to be corrupted and destroyed.

We had to supply our clients with loan kit, and eventually we trashed the MSA2324i, and rebuilt from scratch, and restored from backups and lon MSA.

0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
1. Yes I would backup!
2. I would schedule for a weekend. (start Fri eve 6pm)
3. Yes, you need to shutdown controllers, whiuch means all your VMs
4. Good Luck!
0
 
LVL 47

Expert Comment

by:dlethe
Comment Utility
It is good form to do a backup, but not for the reason HP gave you.  Verify is a safe operation.  However, when you go through the process you are reading every block on every disk and are effectively running a stress test on every disk in your system at once.   If a disk is going to fail, it will be during this time

So the backup is not because the verify isn't safe, it is because you have a high risk of drive failure.
0
 
LVL 16

Expert Comment

by:Gerald Connolly
Comment Utility
Just look at it this way, a bit of inconvienence to do a full backup versus major trauma if the "fixes" crash the system and/or corrupt your data.

Of course you should do a backup before doing this. You should always do a backup before any kind of change.
0
 

Author Comment

by:georgedschneider
Comment Utility
I agree with you there.  It was really a matter of the dowtime to take down an entire site.  the MSA is our storage for the location host the VHD's.  What is best way to copy the VHD's off.  I was thinking with the Hyper-V servers turned off I would just copy the VHD's to a external USB drive via USB 3.0.  There's about 1.5 TB of data.
0
 

Author Comment

by:georgedschneider
Comment Utility
We just had the power supply fail again and HP finally agreed to replace it verses having us reseat it which caused the psu unit error go away for a little while. Funny thing is after replacing the power supply the parity errors went awY. A verify VDisk even completed error free. What do you make of this?
0
 

Accepted Solution

by:
georgedschneider earned 0 total points
Comment Utility
We just had the power supply fail again and HP finally agreed to replace it verses having us reseat it which caused the psu unit error go away for a little while. Funny thing is after replacing the power supply the parity errors went awY. A verify VDisk even completed error free. What do you make of this?
0
The curse of the end user strikes again      

You’ve updated all your end user’s email signatures. Hooray! But guess what? They’re playing around with the HTML, adding stupid taglines and ruining the imagery. Find out how you can save your signatures from end users today.

 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
HP have replaced and re-designed the PSUs for the MSA range.

Does you new supply have 1 LED or 2 LEDs on the rear, later revision supplies just have one LED now, and not two. (also the catches are different colour, from what I remember!)

The older ones, had 2 LEDs, one indicating Power ON, and one indicating Fault!
0
 

Author Comment

by:georgedschneider
Comment Utility
Why would the PSU clear up disk errors?
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
It's odd that it fixes your issue, maybe the supply was failing, unable to provide enough current.
0
 

Author Comment

by:georgedschneider
Comment Utility
Very strange indeed.  But since then I haven't seen any disk errors
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
does this new disk have two led lights or one?
0
 

Author Comment

by:georgedschneider
Comment Utility
New disk?  Both the PSU and Disks have green lights on them.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
sorry new PSU

old psus have two leds

newer versions only have one.
0
 

Author Closing Comment

by:georgedschneider
Comment Utility
This comment resolved the issue I had orignaly had and asked in my question
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

I was supporting a handful of Windows 2008 (non-R2) 2 node clusters with shared quorum disks. Some had SQL 2008 installed and some were just a vendor application that we supported. For the purposes of this article it doesn’t really matter which so w…
Lets start to have a small explanation what is VAAI(vStorage API for Array Integration ) and what are the benefits using it. VAAI is an API framework in VMware that enable some Storage tasks. It first presented in ESXi 4.1, but only after 5.x sup…
This tutorial will give a short introduction and overview of Backup Exec 2012 and how to navigate and perform basic functions. Click on the Backup Exec button in the upper left corner. From here, are global settings for the application such as conne…
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…

772 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now