• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 442
  • Last Modified:

Raid 5 crash

I was upgrading my servers hard drives over the past few days. The setup is raid 5 with 5 drives. I switched one drive at a time and let the configuration rebuild. The last I saw, the 5th drive was 92% complete rebuilding. When I came back the server was bsod and a restart will not boot. I put all of my old drives in and still won't boot. I thought it might be the controller so I tried both sets of drives in an identical server, but neither boot.
 
Out last backup was from over 12 hours ago, which means a lot of lost data. Any ideas on why the servers won't recognize the raid configurations? Any way to get that data back without hiring specialists?

Thanks in advance.
0
dwils15
Asked:
dwils15
  • 2
  • 2
  • 2
  • +3
5 Solutions
 
NetfloCommented:
Do you have a warranty for your server from Dell or HP if so they may be able to help you save the array.
0
 
dwils15Author Commented:
No these servers are at least 6 years old. poweredge 2650's
0
 
NetfloCommented:
Firstly, data loss is a possibility based on what you've described. Sounds like the array did not fully rebuild and / or in the unlikely event have suffered from a hard drive failure from one of the disks in the array.

As its a Dell server and I'm assuming you have a PERC controller, can you check in the RAID BIOS if you can import a foreign array? I've seen this happen before where the array can just blink off and the causes are due to an old firmware which should have been updated prior to doing this sort of work.

Can you post details of your RAID card and version, if my point doesn't answer your question?

Thanks
0
Nothing ever in the clear!

This technical paper will help you implement VMware’s VM encryption as well as implement Veeam encryption which together will achieve the nothing ever in the clear goal. If a bad guy steals VMs, backups or traffic they get nothing.

 
DavidCommented:
What you had a drive failure while the system is in degraded mode.  Just popping back the old disks won't work because, well, the firmware just doesn't let you do that, nor should it let you do that, because the data is stale.   It can't possibly work. It WOULD have worked if the system wasn't booted.

Without hexdumps of the first few MB of all of the disk drives, and the ability to run some diagnostics on the hardware, then I couldn't begin to tell you what the next step is for an assisted recovery.  At this point you are going to have to decide if it is worth a few thousand dollars to you to contract a pro.

I know it is too late for this, but if you look at some of my old postings, then you'll see at least a dozen of them saying NEVER to do what you attempted because it is high risk.  Picking up a bad block when in degraded mode means 100% data loss for many controllers.  Doing this hot to a booted system that is also reading / writing data adds even more risk because you can't manually extrapolate what you need from the older disk drives.   Also the very action of causing the rebuild puts a great deal of stress in disks, and makes it even a higher risk of failure.

Your ONLY hope is professional data recovery.  Had the system never have been booted then recovery would have been much easier.  Sorry.


0
 
chihsCommented:
by the previous experience on storage,
1. software raid need ask the original manufacture and try to recovery by software engineer
2. hardware raid will difficult to recovery because it's handle by the hardware and the firmware, this  need to check the original manufacture for help.
0
 
andyalderSaggar makers bottom knockerCommented:
I would recommend using Raid reconstructor (www.runtime.org/raid.htm) with the first 4 drives, the fifth one isn't any use as only half rebuilt. That should enable you to get most of the data back although the BSOD may have caused something to get over-written.
0
 
PowerEdgeTechIT ConsultantCommented:
As it is likely too late now ... just remember this for future reference:

Support is ALWAYS free on Dell servers (in the States and Canada) - regardless of warranty status.  Your first move in a situation like this is to do NOTHING before calling Dell.  Call as soon as it's down, unless you know what you need to do to fix it.  
0
 
dwils15Author Commented:
Thanks for all the replies. Since we have thousands of people connecting to this server we needed the system running ASAP. We just Installed SQL on another server and restored from our backups. We lost a day of work, but it was our best option.
0
 
andyalderSaggar makers bottom knockerCommented:
Lost a days work :(

Best change SQL to full recovery model and make sure logs are on a different volume for next time you have a problem so you can do a no loss restore.
0

Featured Post

Keep up with what's happening at Experts Exchange!

Sign up to receive Decoded, a new monthly digest with product updates, feature release info, continuing education opportunities, and more.

  • 2
  • 2
  • 2
  • +3
Tackle projects and never again get stuck behind a technical roadblock.
Join Now