How do I replace my filled harddrive with out corrupting my exchange server?

My virtual exchange 2003 server which is being hosted on a dell poweredge 2850 has out grown the hard drive and I need to replace it but there is 20 mb left and the vm is now over 300gb. The vm is running in vmware server 2.0 I have been down for 2 hours now and no one is getting emails right now
LVL 1
sirius7Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

JohnBusiness Consultant (Owner)Commented:
Can you move anything off the machine? Then rebuild the machine or try VMware Converter to make the machine larger.
sirius7Author Commented:
I have no where to run vmconverter on a 300+ GB file. And its our emails. I really dont like the guy who had my job before me. Im copying off the files now, but I wasnt able to convert it prior to copying it. no space and vm dont like travelling across networks for data. More than 5 feet and your asking for it
JohnBusiness Consultant (Owner)Commented:
Do you have any capacity to build a replacement machine? I don't know what other recourse you have?
Ensure Business Longevity with As-A-Service

Using the as-a-service approach for your business model allows you to grow your revenue stream with new practice areas, without forcing you to part ways with existing clients just because they don’t fit the mold of your new service offerings.

JohnBusiness Consultant (Owner)Commented:
Alternative approach; Archive your email to buy time and upgrade your hardware.
sirius7Author Commented:
the system call for scsi drives and the onces I have are useless. The PE has 6 73gb drives. Going to have to rebuildit I guess but was looking for some typme of interim solution. AnYtHiNg!
sirius7Author Commented:
archive it to where? and the vm wont statrt right now due to the fact there only 20mb left
JohnBusiness Consultant (Owner)Commented:
You need to get the machine started if you can. Then have users archive old mail to their local machines temporarily.
sirius7Author Commented:
all 200? they are gonna be P.O! I was right in the middle of building a real virtual center when this happened but im not done, but I am wondering if there is a way I could leave the data on the PE2850 and just use my vcemter to mapp to its vm's?
sirius7Author Commented:
I guess I shoudl have asked how can I turn this PE2850 into a host so my vcenter can access the files so the users can get there email? and then I can set it on fire
JohnBusiness Consultant (Owner)Commented:
The only other way I can see, then, is to get your new setup running, get the old system started somehow, and then copy the Exchange stuff to the new setup and restore it.

If you can get running, you can reduce (even delete) restore points (shadow storage) to make space. Bad idea, but you can do it.

You can make a virtual machine from a real machine, but I do not know if you can reliably go the other way.

.... Thinkpads_User
SurajCommented:
Dismount the store.
Make sure its clean shut down.
if the logs are on the same drive you can move them to somewhere else or delete it. [as database is clean]

you can replance the disk - change the location of the database to it and mount it there Or

On the database - run offline defrag to get rid of white space !


- the defrag would take time [5gb/hr] so you can try with bank database [moving the current database to different drive] to reduce down time and then go for dial tone.
sirius7Author Commented:
ok I got rid of a file that will allow me to boot the vm. Once I do that:

Dismount store.
move logs

I have no Hdrive so Im stuck with the space I make from  the defrag till later. where do I move the logs to and are the necessary to keep on exchnage at this moment?
JohnBusiness Consultant (Owner)Commented:
Also see if you can reduce restore points (since you are going to dispose of this machine anyway).
... Thinkpads_User
sirius7Author Commented:
should i run defrag on the host server first?
sirius7Author Commented:
found my mbdata folder... 75GB can i delete some?
SurajCommented:
you have only one drive?  
are log files and database on same drive ?

whats the size of your .edb and .stm files?
1. stop smtp service so that it doesnt grow more !
2. dismount the store first.
3. check the state of the database . eseutil /mh "db location"
4. if clean - you can delete the log files.

check if you have enough space?

if not. dismount the store - and run offline defrag on the store !
sirius7Author Commented:
doing that now.
sirius7Author Commented:
edb: priv 16 gb
stm 8.5 gb

how do i know if its clean?
sirius7Author Commented:
what do I use to defrag the file?
SurajCommented:
What is the size of your drive?

for defrag : you can use eseutl /d . pls follow article :

http://support.microsoft.com/kb/192185
http://technet.microsoft.com/en-us/library/aa997972(EXCHG.80).aspx
Nagendra Pratap SinghDesktop Applications SpecialistCommented:
Compress the logs.

I know many people recommend otherwise but I had to do it several times because I have cheap clients.


lscarborCommented:
If you can connect an external drive (and the VM sees it) you can run a windows backup. Important: Use the one that comes with 2003. Check the box for the exchange stores.
This will do 2 things: you'll have a backup, and it will 'roll up' the exchange log files. This will give you some room and you'll be able to achieve some of the suggestions the other experts have put forth.
sirius7Author Commented:
Im now trying to get back into the exchnage vm but its telling me when I start the vm  it gets to 95% then I get the following:

"Power On Virtual Machine" failed to completeOKIf these problems persist, please contact your system administrator.DetailsVMware Server cannot find the virtual disk "MailServer-0-000001.vmdk". Please verify the path is valid and try again.
Cannot open the disk 'C:\Virtual Machines\MailServer\MailServer-0-000004.vmdk' or one of the snapshot disks it depends on.
Reason: The system cannot find the file specified.

But I know its there.
lscarborCommented:
I'd call Dell server support and get help with checking the drives.
sirius7Author Commented:
when trying to reconfigure thru the web access i get:

A general system error occurred: The called function cannot be performed on partial chains. Please open the parent virtual disk
sirius7Author Commented:
Im copying the data to a new data store on a different server. The PE 2850 is in an unstable condition to state the work on. I will have to convert it away from vmware server to a file type vcenter can manage. The size of the PE2850 HD is 347 and the vm's total up to 337GB. Im at 49% now and Im using veeam to transfer the files.
sirius7Author Commented:
I was able to copy the files to an esx server to use in my vcenter but I keep getting that is missisng a file
sirius7Author Commented:
Called Dell and they said they can't help. One of the disk is now saying invalid
sirius7Author Commented:
thank you
sirius7Author Commented:
Even with one of the virtual disks reading invalid I should run converter? I was successfully able to copy the files to an esx server which is serving as a datastore to my vcenter 4. But when trying to power on I get an error stating file missing but doesn't say which file.
sirius7Author Commented:
Is there a way to run converter from vcenter?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
one of the virtual disks reading invalid?

please explain?
sirius7Author Commented:
In the vmware infrastructure web access console under hardware hard disk 2 (scsi 0:1) hard disk not valid.
sirius7Author Commented:
Now the storage area to where all of this has been copied to is not having space issues just not able to power up due to unknown missing file.
sirius7Author Commented:
pic of data
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
is the unknown missing file causing issues to the OS?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Remove the disk from the Virtual Machine.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
It's possible as there would appear to be snapshots on the disk, the disk has ran out of disk space, causing this disk to have issues.

You could remove the disk from the server, but this disk is probably needed by Exchange.

either

1. add more disk space
2. complete a Conversion off the server to help with the snapshot issue.
3. you will then need to try and recover the faulty VM disk. By manually trying to clone the disk.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
sirius7Author Commented:
Removed as instructed and trying to power on in vmware server 2.0
sirius7Author Commented:
It frickn powered on......
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
this disk probably played an important opart for Exchange Server?

do you know what was on the disk?
sirius7Author Commented:
I'm logged into it now trying to Determine what was lost
sirius7Author Commented:
My entire 256 exchange drive is gone.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
yes, as expected.

do you have a backup?
sirius7Author Commented:
Yes. What was copied to the vcenter.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
did this include the faulty disk?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
which disk was removed?
sirius7Author Commented:
Yup. I'm examining the files to see what is missing or diff to copy over
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
if you DO NOT have a backup before the event.

you will have to see if you can recover the missing disk, and manually merge the snapshots, or complete a clone of the disk and create a new disk from the old and snapshots.

BUT to do this will require free space on the host disk?
sirius7Author Commented:
I've tried to just add the esx data storage to the vmware 2.0 server host and I'm not quite clear on the settings. This would avoid merging the files
sirius7Author Commented:
this is the data store i am trying to set but having issue. the datastore settings are as following:

ip: 10.30.30.103
file location: vmfs/volumes/ESX2_storage/Mail/


The server response included one or more errors.OKIf these problems persist, please contact your system administrator.DetailsInvalidNetworkResource: Operation failed.
 datastore settings
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
I now confused what are you trying to do?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
using datastores via a network share is dangerous, and you MUST ensure you have GOOD NETWORKING!
sirius7Author Commented:
trying to add another datastore. Where I have the original copy of this stored.
sirius7Author Commented:
now that I found the missing file and tried restarting the server on vcenter Im getting the following error:

Power On virtual machine
MailServer
Cannot open the disk '/vmfs/volumes/-459fd451--eb23d714-6ca6-001-88b391e07/Mail/Mail-Server-0--000004.v-mdk' or one of the snapshot disks it depends on. Reason: Broken pipe.
System VCENTER
sirius7Author Commented:
And these are all the original files
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
is this VMware Server?

whats vCenter doing?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
the virtual disk is broken and. will needed to be cloned using latest snapshot.
sirius7Author Commented:
The vmware server version was able to boot but we lost exchange when I removed the invalid drive. The vcenter version is trying to power on but get the broken pipe message
sirius7Author Commented:
ok so how do I do this without waisting space and preserving a copy of the existing files?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
it was to be expected that exchange would have a missing hard drive!

do you understand this virtual hard disk is faulty?

did you import this virtual server into ESX?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
how much space on the VMware Server?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
what is the name of the faulty disk?
sirius7Author Commented:
MailServer-0-000004.vmdk is the faulty disk. I used veeam to copy the files from the vmware server to vcenter
sirius7Author Commented:
Creating a clone in vcenter now
sirius7Author Commented:
Should I be concerned that the clone will be using the same datastore?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Im a little confused?

do you have VMware Server and aN ESX or ESXi server? (vCenter)

vCenter is just a management server not a hypervisor host?

Do you also know what you are doing?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Mailserver-0 is the virtual disk

the numbers after are incremental snapshot numbers?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
we need to copy and merge mailserver-0 main disk and snapshots, this will require space on a datastore, how much free do we have?
sirius7Author Commented:
Yes I have a strong idea of what I'm doing. The vm was originally being hosted by vmware server 2.0 and ran out of space. So then I used Veeam to copy it into and esx 4 server. After realizing that space was an issue on the existing vmware server I have tried to power it up via the sphere client (vcenter) but now getting the broken pipe.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
It would have been best to leave on VMware Server and complete clone from snapshot. if you had the space on datastore.

Ill leave you to it, post back if you have issues.
sirius7Author Commented:
If we can make space on the pe2850 if we delete what files are not needed
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Create a Snapshot whilst the VM is OFF.

wait 60 seconds

Delete the Snapshot.

Check if the snapshot has been removed, otherwise manual commands are required.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
ALL FILES are needed you cannot delete Any VM files.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
we are going round in circles here, you have opened another question, to discuss the same issue, Ive just remember and I thought this was a discussion I had before.

What happened to adding more disk space?
sirius7Author Commented:
Was not able to create space. Ok so now it's been 90 seconds and now delete snapshot from disk thru console by selecting remove snapshot?
sirius7Author Commented:
Please forgive the reorganization of the question. The administrators made the change for me which moved the question to a diff zone. My apologies and no disrespect was intended. Your advice has helped me way to much in the past for me to simply disregard what your telling me
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
So you cannot add any more space. to the VMware Server?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
this is the old question, which is a different question?

http://www.experts-exchange.com/Software/VMWare/Q_27530949.html

Delete the Snapshot. Check if the Snapshot has gone.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
do you have space on the current datastore?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
what you need to do is this

vmkfstools -i <most recent snapshot file name> /vmfs/volumes/<temp folder name>/<newfilename.vmdk>
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
at the console. (either via SSH or KVM)
sirius7Author Commented:
Ok when removing the snapshot I get the following:

Task ID:                vm.Snapshot.remove
Target:                  MailServer
Status:                  Error
Triggered At:      01/31/12 2:58:15 PM
Triggered By:     Administrator
Completed At:  01/31/12 2:58:18 PM
Description:        Remove snapshot and delete its associated storage
Error:                     Insufficient disk space on datastore ''.

But when I check the drive the snapshot is gone but now I have less space again.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
what datastore?

ESX datastore?

all snapshots gone, please send screenshot
sirius7Author Commented:
after snapshot was removed from vmware server 2.0
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
snapshots still exist clone out as above
sirius7Author Commented:
So how do I remove them manually from dos prompt?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
you do not remove them.

you create clones of them, and once you have all the clones completed and working in the VM, then you delete.
sirius7Author Commented:
Ok have made a complete backup and going to start merging files
sirius7Author Commented:
Now that I merged the correct files
I booted the vm to measure the success of image recovery = 100%
Line by line combed thru config file noting files set to false or not mentioned
 Then moved those files creating 25GB.
While logged into vm as local administrator ran converter

Now the vm is running in the vcenter with vmotion and redundancy policies.

Dude when you finally get your pic of you wearing cape + mask I want my Xlarge pre-ordered. If this sounds like a small case of hero worship is it because I'm on 1 knee? Thank you again?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization ConsultantCommented:
Thanks for your kind words, currently waiting for Expert of the Year 2011 Trophies, and when I've got them, I'll be posting a picture of me holding them on Andysworld! (my blog http://andysworld.org.uk).

All the Best

(watch that disk space! and those Evil Snapshots!)
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Exchange

From novice to tech pro — start learning today.