Solved

DELL PowerEdge 2900 - disappearing files/ folders

Posted on 2011-03-09
19
1,538 Views
Last Modified: 2012-05-11
Current environment;

DELL PowerEdge 2900 with RAID 5 Configuration running Windows 2000 Advanced Server (SP4) / Windows XP Pro workstations.

Hi There,

Been experiencing this issue over the past 3 months now whereby data folders on the server literally just disappear! - I have ruled out users deleting or moving folders as I enabled auditing on the server – There is also no pattern that I can see, e.g. it’s not happening at the same time or particular day e.g. it is totally random, it can happen one or two days in a week or it may be fine for an entire week but then experience data disappear in week two.

Some of the things I have tried are as follows;

-          Flashed to latest BIOS (this was an Urgent requirement on DELL’s site).
-          Upgraded to latest firmware for DELL PERC 5/i integrated.
-          Upgraded to latest firmware for DELL SAS 5/i integrated.
-          Installed latest PERC 5/i integrated driver.
-          Installed latest SAS 5/i integrated driver.
-          Checked DELL OpenManage Server Administrator (no warnings / errors).
-          Performed full virus scan.
-          Checked Event Viewer (nothing obvious).
-          Performed Windows update.

Post the changes above I must say that I didn’t experience any disappearing of files / folders for over 3 weeks but today I have experienced the same issue.

Any ideas would be most welcomed as this is becoming a nightmare to support as I’m sure you can imagine.

Many thanks,

Sam.
0
Comment
Question by:sam180y
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 10
  • 6
  • 3
19 Comments
 
LVL 14

Expert Comment

by:JAN PAKULA
ID: 35082143
1. do you have DFS (Distributed file system) on domain?
2 Can you recover files with http://www.piriform.com/recuva ?

Jan MA CCNA
0
 

Author Comment

by:sam180y
ID: 35082247
janpakula, No, not using DFS - recovery of files isn't my issue here, my issue is why and how they are disappearing in the first place.
0
 
LVL 14

Expert Comment

by:JAN PAKULA
ID: 35082301
question is can you recover  them at all? - if yes that would mean that the server receives files correctly - but removes them for some reason - if not then you hve problem with server receiving files at first place.
0
Free NetCrunch network monitor licenses!

Only on Experts-Exchange: Sign-up for a free-trial and we'll send you your permanent license!

Here is what you get: 30 Nodes | Unlimited Sensors | No Time Restrictions | Absolutely FREE!

Act now. This offer ends July 14, 2017.

 

Author Comment

by:sam180y
ID: 35082361
Yes I can recover them - I'm using CA ARCserve Backup r12.0 that I use to perform full backups to tape - as you can imagine I'm relying on these backups quite a bit of late - when I restore the data it is usable and can be read from and written to quite happlily - however i will experience data disappear (not necessarily what was previously restored either).
0
 
LVL 14

Expert Comment

by:JAN PAKULA
ID: 35082460
it looks like your raid installation failing (maybe one of hard drives is starting to fail ) use this for testing
http://hddscan.com/ 
u should have some tools from dell server management to test it

Jan
0
 

Author Comment

by:sam180y
ID: 35082632
Jan, the DELL OpenManage Server Administrator isn't showing any errors or warnings but I will try the 'hddscan' and revert - Many thanks.

Sam.
0
 
LVL 33

Expert Comment

by:PowerEdgeTech
ID: 35083956
Server Administrator is good for monitoring real-time status and interacting with the hardware, but it does not include diagnostics.  I would run extended Online Diagnostics from Windows and Extended 32-bit Diagnostics from outside of Windows ... if you believe it is hardware related.  The thing is, even with a failing RAID controller, if the files were there at some point, there is no RAID failure that is going to "erase" a folder - once written to the drives, it's there.  You may have a faulty drive(s) or a corrupt file system or RAID array.

Again, I don't believe it is hardware at this point, but out of curiosity ...

-          Flashed to latest BIOS (this was an Urgent requirement on DELL’s site).

Did you also upgrade the ESM/BMC?  This should always be updated with the BIOS.

-          Upgraded to latest firmware for DELL PERC 5/i integrated.
-          Upgraded to latest firmware for DELL SAS 5/i integrated.
-          Installed latest PERC 5/i integrated driver.
-          Installed latest SAS 5/i integrated driver.

- Which do you have ... the PERC 5/i or thr SAS 5/i?  You can't have both :)  If you have a PERC, you can check the controller log for possible errors within the array.
- And, did you also upgrade the hard drive firmware?
- How many disks are you using?  RAID level?
0
 

Author Comment

by:sam180y
ID: 35084193
Hello PowerEdge Tech,

Sorry what is ESM/BMC? I do actually have both PERC 5/i and SAS 5/i - I am using PERC 5/i configured with RAID 5 using 5 x 400GB SAS drives (setup as a virtual disk) - SAS 5/i is in a PCI slot used for the internal tape backup unit - Where can I check the controller log for my PERC?

No, I have not upgraded the hard drive firmware.

When you refer to "I would run extended Online Diagnostics from Windows and Extended 32-bit Diagnostics from outside of Windows", what tools would you recommend here?

Many thanks.
0
 
LVL 33

Accepted Solution

by:
PowerEdgeTech earned 250 total points
ID: 35085506
ESM (Embedded Server Management - the device that works with BIOS to manage and monitor the system):
http://support.dell.com/support/downloads/download.aspx?c=us&cs=04&l=en&s=bsd&releaseid=R158443&SystemID=PWE_2900&servicetag=&os=WNT5&osl=en&deviceid=7603&devlib=0&typecnt=0&vercnt=4&catid=-1&impid=-1&formatcnt=0&libid=13&typeid=-1&dateid=-1&formatid=-1&source=-1&fileid=211654

SAS 5/i can be used in non-RAID mode, which would be required to use it with a tape drive ... so, I'll give you that one :)  It's just an unusual setup.

You can get the controller log from OMSA ... Storage, PERC, Information/Configuration (link at top of page), Export Log from dropdown.  Note where it saves it (usually C:\).

They are actually called Online Diagnostics (for Server 2000, it is PowerEdge Diagnostics):
http://support.dell.com/support/downloads/download.aspx?c=us&cs=04&l=en&s=bsd&releaseid=R158443&SystemID=PWE_2900&servicetag=&os=WNT5&osl=en&deviceid=7603&devlib=0&typecnt=0&vercnt=4&catid=-1&impid=-1&formatcnt=0&libid=13&typeid=-1&dateid=-1&formatid=-1&source=-1&fileid=211654

and 32-bit Diagnostics (runs outside of Windows):
http://support.dell.com/support/downloads/download.aspx?c=us&cs=04&l=en&s=bsd&releaseid=R212797&SystemID=PWE_2900&servicetag=&os=WNT5&osl=en&deviceid=196&devlib=0&typecnt=0&vercnt=11&catid=-1&impid=-1&formatcnt=0&libid=13&typeid=-1&dateid=-1&formatid=-1&source=-1&fileid=301057
0
 

Author Comment

by:sam180y
ID: 35092765
Many thanks for the clarity PowerEdge Tech.

I tried to upgrade the ESM/BMC but a message came back saying it couldn't find any devices - I did however manage to run the Online Diagnostics and ALL tests passed, I will try running the 32-bit diags (outside of Windows) this weekend.

I also exported the log for the PERC (which I have attached), is there anything in your opinion that is showing up possible areas for concern?

Appreciate your support.

 lsi-0309.log
0
 
LVL 33

Expert Comment

by:PowerEdgeTech
ID: 35098685
sam180y ... nothing in the log jumped out at me ... everything seems to be in order there.
0
 

Author Comment

by:sam180y
ID: 35121200
Thanks for giving it the once over PowerEdgeTech, much appreciated!

I managed to successfully run the diags (outside of Windows) and all tests passed (I used the Express option) – I also managed to successfully upgrade the ESM/BMC firmware in the end by using the Update Package for Microsoft Windows from DELL Drivers & Downloads (as opposed to the Hard-Drive option).

However, I tried to perform the same exercise with the SAS drive firmware upgrade but every time I launch the Update Package I’m displayed with the error message “The procedure entry point RegDeleteKeyExA could not be located in the dynamic link library ADVAPI32.dll.”, when I click OK it displays “Inventory collection failed.” It’s as though it cannot detect the hardware, when I checked the model of the SAS drive on the server using OMSA it shows I have 5 x 418.62GB SAS drives, product ID HUS154545VLS300, Revision D522, the closest I could find on the DELL site is for a 450GB SAS drive (with exactly the same product ID), revision D598.

Any ideas on this?

Sam.
0
 
LVL 33

Assisted Solution

by:PowerEdgeTech
PowerEdgeTech earned 250 total points
ID: 35121958
The SAS drive firmware utility is bootable and won't run from Windows unless you purchased DUP-enabled drives, allowing for online firmware updates, which it sounds like you don't have:
http://support.dell.com/support/downloads/download.aspx?c=us&cs=04&l=en&s=bsd&releaseid=R288929&SystemID=PWE_2900&servicetag=&os=WNET&osl=en&deviceid=10167&devlib=0&typecnt=0&vercnt=20&catid=-1&impid=-1&formatcnt=0&libid=44&typeid=-1&dateid=-1&formatid=-1&source=-1&fileid=430113

Looks like my copy/paste didn't "take" for the link to the ESM update ... it is actually the same link as for the diagnostics ... sorry :)
0
 

Author Comment

by:sam180y
ID: 35122077
No probs, That makes sense I will give this a try and revert, I did actually download this earlier, will action this once I'm back onsite.

Appreciate your continued support.

Sam.
0
 
LVL 33

Expert Comment

by:PowerEdgeTech
ID: 35122327
Good luck.
0
 

Author Comment

by:sam180y
ID: 35158255
Just to keep you posted, I will be trying the SAS drive firmware upgrade over the weekend, gives me some contingency - will update you accordingly.

Thanks again.
0
 

Author Comment

by:sam180y
ID: 35172799
Successfully managed to upgrade the SAS drive firmware using the SAS drive firmware utility - Will monitor server behaviour and will reopen this ticket should I start experiencing the same issues.

Many thanks for your guidance.

Sam.

0
 

Author Closing Comment

by:sam180y
ID: 35172825
Because of the nature of the problem a period of time (unkown) will be necessary to ascertain whether the proposed solutions actually worked - will reopen ticket should the problem reoccur.
0
 
LVL 33

Expert Comment

by:PowerEdgeTech
ID: 35173444
Sounds good ... good luck.
0

Featured Post

Connect further...control easier

With the ATEN CE624, you can now enjoy a high-quality visual experience powered by HDBaseT technology and the convenience of a single Cat6 cable to transmit uncompressed video with zero latency and multi-streaming for dual-view applications where remote access is required.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will learn how to backup a VMware farm using Nakivo Backup & Replication. In this tutorial we will install the software on a Windows 2012 R2 Server.
Is your phone running out of space to hold pictures?  This article will show you quick tips on how to solve this problem.
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

696 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question