Solved

iSCSI LUN share between Windows 2003/2008 corrupting files.

Posted on 2011-09-19
7
224 Views
Last Modified: 2012-05-12
In our haste to get a failed server up and running we have managed to get two separate servers talking to the same LUN on a storage device with disastrous results.  Both a WIndows 2003 server and Windows 2008R2 server are connected to the same shares with the same security.  This has caused some kind of discrepency that now has files unreadable or corrupted, some by one, but not the other and vice versa.  We have tried committing to one server or the other, but files end up missing, or unreadable.  Currently all users access through Windows 2008R2 mapping, while the temporary Win2003 server remains connected, but not accessed.

The backups may not be of any use, as they were pointing to files they couldn't read.

It seems like everytime I "touch" a file, from one server or the other, the file becomes corrupted.  I'm assuming there's something very wrong about 2003/2008R2 both connected to the same folder share?

I'm in real trouble with this one gang.  Lost files, corrupted data, no backup...

I did run a chkdsk on the Win 2008 server and that only seemed to make matters worse.  I've left out many details, and specifics, just because I'm not even sure where to begin or where the problem lies.
0
Comment
Question by:MCHCPAnalyst
  • 5
  • 2
7 Comments
 
LVL 14

Accepted Solution

by:
setasoujiro earned 500 total points
ID: 36562866
Ok , you should NEVER access a LUN with 2 machines , this said:
you disconnected server 2003 from the LUN correct?
now run a chkdsk /f again.

Also , do you have any shadow copy running on the LUN?

try to do some test restores from backup and see what this does.

I would also suggest to try and clone the LUN before doing anything else, in cse something goes even more wrong you still have the cole
0
 

Author Comment

by:MCHCPAnalyst
ID: 36563188
Quite right about the LUN on two machines, but that's another story.

These are good suggestions and will take some time.  I'm currently getting what I can backed up to avoid any further corruption.  I'll probably have more clues tomorrow.  Sorry to leave you hanging until then.

Thanks!
0
 

Author Comment

by:MCHCPAnalyst
ID: 36563306
I'll just add to clarify.  No shadow copy, no more space on the SAN for cloning.
0
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

 
LVL 14

Expert Comment

by:setasoujiro
ID: 36564926
no i mean use something like Acronis, and clone to external USB from windows
0
 

Author Comment

by:MCHCPAnalyst
ID: 36567623
Just an update:  I spent most of the night manually moving files to plain vanilla storage on another server, a very tedious process when things are smattered with corrupt files.  But it insured I at least had the bulk of the files before proceeding.

Came in this morning remembering my storage device offered a small trick.  I'm currently backing up what is available from the SAN to an external USB disk, but I'm able to utilize functionality built into the storage device for the external offload of data, no VSS required.  It's about the only interesting feature I've seen from my Cybernetics MiSAN - but that's another story.  It's about .5TB so it's going to take some time.

Sorry to have to move so slow, but I'm erroring on the side of caution as much as possible.
0
 

Author Comment

by:MCHCPAnalyst
ID: 36581664
I've recovered the lion's share of files through backups, but still have data corruption to deal with on many files.  I am convinced the issue is that Win2008 and Win2003 were simultaneously accessing files.  I'm vaguely aware that security is quite different for these OS's.

I'm still unable to run a chkdsk until I have made a copy of the copy straight out of the storage device, it's taking an inordinate amount of time - 36+hrs using DriveXML and only 43% complete.  Had to cancel, need something faster.  With NTBackup (faster for some reason?) I immediately get a <drive>\$secure is "corrupt and unreadable" error but the backup goes on.  I want to make sure I can restore the storage-direct-copy before attempting any repairs or disk checks, so again I'm dead in the water until that is complete.  Until then, I'm going to try and repair the files I have restored from backups.

I'm going to award the points and move on to this issue.  Thanks for the help!
0
 

Author Closing Comment

by:MCHCPAnalyst
ID: 36581675
This is effectively the only thing you can do without going into forensics.
0

Featured Post

Use Case: Protecting a Hybrid Cloud Infrastructure

Microsoft Azure is rapidly becoming the norm in dynamic IT environments. This document describes the challenges that organizations face when protecting data in a hybrid cloud IT environment and presents a use case to demonstrate how Acronis Backup protects all data.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Stuck in voice control mode on your Amazon Firestick?  Here is how to turn it off!!!
Employees depend heavily on their PCs, and new threats like ransomware make it even more critical to protect their important data.
This tutorial will walk an individual through locating and launching the BEUtility application to properly change the service account username and\or password in situation where it may be necessary or where the password has been inadvertently change…
This tutorial will show how to configure a new Backup Exec 2012 server and move an existing database to that server with the use of the BEUtility. Install Backup Exec 2012 on the new server and apply all of the latest hotfixes and service packs. The…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question