Question

HELP - DEFRAG EXCHANGE 2003 SBS DATABASE

Asked by: hometech1

Been here a long time but never asked a question...now I am desperate.

I have a client whose new business has been growing by leaps and bounds very quickly.  They now have 30 desktops - half are MAC/entourage users and half are PC/outlook users.  Their exchange SBS2003 database has reached its maximum size of 75 GB.  I have been archiving mail like crazy the last couple of weeks and it has not helped much...the database keeps growing.  I have added up all the mailbox sizes and their database should only be about 45GB now. but the Priv1.EDB is 58GB and the Priv1.STM is 21GB.  I got a warning yesterday that it was over the 75GB limit and the db was dismounted automatically.  I know there is several GB of whitespace in the db since i have been archiving.

I started an offline defrag to reclaim the space but after running all night long - for 8 hours now, its only at 4% !!  It reached 4% the first 30min and has not moved since.  I run the performance monitor and the disk activity is pegged at 100%.  I am not sure what to do.  

I thought this could finish overnight on Thursday night but I underestimated how long it would take and they will want their mail today.  I can start it again Friday night and do it all weekend if needed but I ont know if i did something wrong.  I ran a backup before doing the defrag.  I ran the ESEUTIL /d command and that was it, no other options as shown in the image below.

My questions are:  
1. Can it can be stopped now?  
2. Will stopping corrupt the EDB?
3. Is there anything I can do to speed this up or is this slowness normal?
4. General advice, tips, pointers are appreciated..
The attached image is after 8 HOURS!

Thank You

  • Snip1.JPG
    • 42 KB

    The attached image is after 8 HOURS!

    The attached image is after 8 HOURS!

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2009-11-06 at 04:49:14ID24877672
Topic

Exchange Email Server

Participating Experts
4
Points
250
Comments
42

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. Connect Entourage to an Exchange SBS2003 Server via…
    Hi I know that you can connect MS Outlook to an SBS2003 Server via https is ther a way to do this with Entourage? I have remote users using laptops that will need to be able to access a SBS2003 server while traveling with an internet connection. Any help will be appreciated. ...
  2. sbs 2003 and defrag
    sbs 2003 and defrag
  3. Exchange 2003 on SBS with MS CRM STM file very larg…
    I am documenting this issue for other users. No response is necessary. Background: I am running a MSSBS 2003 Pro server with Exchange, SQL and Microsoft CRM running on the SBS box. We are a small company with 6 CRM users and the CRM system has been up and running for appro...
  4. Microsoft, Entourage, 2004, Exchange 2003
    Hi, We have a site that has SBS 2003 SP2, PCs and Macs. On the Macs, Entourage 2004 is installed, but the mailboxes in entourage are not syncing with the exchange. i.e. A user deletes her mails in the deleted items, entourage syncs with the server and the emails are back agai...
  5. Configuring Entourage 2008 with Exchange 2003 SBS
    Hello All, I have a new user who is using a MAC with Entourage 2008. I need to configure them to connect to an internal Exchange 2003 server running on SBS 2003. From my understanding it requires IMAP4 to be enabled which I did in the Services and started it as well. ...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: BrumlePosted on 2009-11-06 at 04:59:35ID: 25758688

First of all as I mentioned in another thread. You should always keep some GB available for the database if it fills up. You can decrease the limit to fe. 73 GB in the registry when the issue is solved. Check your mailbox store to se if you have enabled "keep deleted items" & "keep deleted mailboxes" for days.

 

by: hometech1Posted on 2009-11-06 at 05:03:02ID: 25758703

I had only set the limit at 70GB but since it dismounted automatically and the edb and stm files together are almost 80 i assumed it was maxxed out.  I turned off retention yesterday to see if it would make a difference.

 

by: demazterPosted on 2009-11-06 at 05:04:37ID: 25758709

Stopping will/can cause corruption on the database, best practice is that you run a defrag on a copy of the database for this reason.

The physical size of the files does not represent the actual size limit.

The logical size of the database can be calculated by adding the size of the EDB and STM file and then minus the amount of White space reported in the event viewer.

So you could have a 100GB physical file as long as you had more than 25GB of white space.  White space is created by removng deleted items from the "dumpster" this is dine by archiving combined with setting the deleted items retention period so the dumpster is emtied, see here:

do you have a backup of your information store? If so then if stopping the defrag corrupts the database you can restore from backup.

 

by: demazterPosted on 2009-11-06 at 05:07:48ID: 25758731

 

by: hometech1Posted on 2009-11-06 at 05:07:54ID: 25758732

is it normal for this to take so long or could something be wrong?

 

by: demazterPosted on 2009-11-06 at 05:13:36ID: 25758762

I am afraid there is no simple answer to that, some people will quote 2-3 hours per GB others 5-7 per GB.

It really does depend on server hardware and if it's doing anything else.  It will normally crash with an error message if there is a problem.
See here: http://www.petri.co.il/defragment_exchange_2000_2003_server_databases.htm

 

by: demazterPosted on 2009-11-06 at 05:15:47ID: 25758776

Just also note that unless physical space is an issue for you there really is no need to do an offline defrag.

In 2003 with SP2 applied the database is dusmounted during the maintenance window, this does not stop you re-mounting it it just means the next time maintenance runs it will get dusmounted again.

 

by: BrumlePosted on 2009-11-06 at 05:26:02ID: 25758830

This is not an easy issue. I think your defrag are way to slow. Your issue now are wheter you should wait or rely on your backup. As i mentioned, you should confirm that deleted items are not stored in the database. If the registry setting is 70 GB it should dismount on that level. When you get the server up and running, you could also export some of the worst users to pst. and store it outside the Exchange if possible it will buy you some time.

 

by: hometech1Posted on 2009-11-06 at 05:26:11ID: 25758831

but isn't offline defrag meant to reduce the side of the db?  how do I know what my actual db size is?

 

by: RancyPosted on 2009-11-06 at 05:33:17ID: 25758877

Also dont forget to run the isinteg command after the defrag completes as there couls be some broken or misplaced pointers in the database and they can cause more issues like:- User see a mail in Outlook but when click get an error - reason broken pointers...... So better to run the command
Also as Demazter said that it runs at 4-5 GB approx but very much depends on the server performance ...... so just keep it light tilll the command is running and can take some time and might look like its stuck .... to check that its not stuck and running open the task manager and go to Processes tab and select columns for I\ORead, I\OWrite, I\OReadBytes and I\OWriteBytes and just monitor to see if its running in the background

isinteg -s {Exchange server name} -fix -test alltests

 

by: RancyPosted on 2009-11-06 at 05:34:24ID: 25758883

Once the Offline Defrag completes you would see the reduced size of the database  ..... you would only get the free space in the database at the time you ran the Offline Defrag..... do you know what the free space was ??

 

by: demazterPosted on 2009-11-06 at 05:37:43ID: 25758906

Have a look at this document from EE expert Mestha it explains in more detail what I have already said above: http://www.amset.info/exchange/event1221.asp

 

by: hometech1Posted on 2009-11-06 at 05:38:44ID: 25758912

not sure how to find out...

 

by: demazterPosted on 2009-11-06 at 05:39:09ID: 25758916

As I already mentioned the physical size ofthe database does not matter, it's the logical size that the limit is set to.

If you reach the limit it will not stop you from mounting the database it will just be disjointed when the maintenance runs.

 

by: RancyPosted on 2009-11-06 at 05:48:57ID: 25759002

If you ever have to check the free space in the database you will have to dismount the database and run the command
eseutil /ms "location of the .edb file"
This would scan the entire database and give you number of free pages - multiply the number of free pages by 4 and that gives you total in KB now you can find the free space in MB or GB accordingly ..

 

by: shauncroucherPosted on 2009-11-06 at 05:54:49ID: 25759060

OK,

You made a mistake starting that offline defrag if you are using Exchange 2003. As demazter points out, it will look at the logical size, which is basically the physical size of DB less the space reported in event 1221 in event logs.

You say that last night it was at 4% and this morning it is stil at 4%, so it is either stuck, or it has reached a point where it is not managing to complete 1% of the job in 8hrs. Either way, thats a major problem. At some stage you may have to make a decision to remount the original database from backup. Remember, you didn't need to defrag the file in the first place.

If it suddenly picks up, it is not going to take any less that a further 18hrs, and thats if it manages 4GB per hour, which is on the faster end of the process.

Perhaps you might need to bite the bullet and restore from backup, unless downtime in terms of days is better than the risk of cancelling and restoring from backup.

Shaun

 

by: hometech1Posted on 2009-11-06 at 05:54:53ID: 25759064

guys thank you all for the useful information but I think I am going to have to cancel the defrag and restore last nights backup and try again tonight and let it go all weekend if needed. I am already getting grief from the client. what can I do to make the defrag faster?

 

by: demazterPosted on 2009-11-06 at 06:13:41ID: 25759233

You could consider copying the file to a faster/higher spec machine and running a defrag from there.

If it's getting stuck it may be down to corruption so you may want to run ISINTEG in it first.

You may be lucky and you don't have to restore from backup but before you try again do an ISINTEG and remember, when you do the offline defrag do it on a copy of the file or at least make a copy somewhere else before you start.

Also is a defrag really necessary? The information I proceed earlier about retention periods should suffice unless physicalspaxe is an issue.  Set the retention period to 1 day and then do some archiving.

 

by: shauncroucherPosted on 2009-11-06 at 06:33:28ID: 25759385

Why does he need to do a defrag? He doesn't need to defrag the file, as the limit will be based on the logical size, so as long as online maintenance has been run against the database with retention set to 0, he will not need to run it?

Shaun

 

by: hometech1Posted on 2009-11-06 at 06:37:21ID: 25759422

fyi: the server is a quad core 2.66 with 4gb ram.  hard drives are a raid1 sata 1tb.

holy cow, it just jumped to 8%...after 10 hours, it actually made some progress.  i am tempted to take the heat and  try to convince the client that they have to stick it out today with no email...what do you guys think?  is there any way i can make a calculation on how much time i have left based on what it is done already?  i started it at 1130pm last night.  now at 930am its still at 8%

 

by: hometech1Posted on 2009-11-06 at 06:38:52ID: 25759435

ok, here's a theory...can i restore my backup to a different location and run that production database while this one defrags?

 

by: demazterPosted on 2009-11-06 at 06:49:46ID: 25759532

Hi Shaun, agreed.....isn't that what I said in my last sentence?

 

by: shauncroucherPosted on 2009-11-06 at 06:51:23ID: 25759549

messy. You could do it for access to historical mail, but if they are using cached mode in Outlook they should have that anyway.

You can' make it fully live because then you won't be able to put the 'defragged' one back in production without transferring mail from the restored one to the defragged one.

Shaun

 

by: demazterPosted on 2009-11-06 at 06:51:34ID: 25759551

You may be wasting your time!
If you have no White space then te defrag will not reduce the size of the file, however now you have started it I would suggest you continue!

Check for the Event 1221 in the event viewer how much White space have you got?

 

by: shauncroucherPosted on 2009-11-06 at 06:55:18ID: 25759592

The maths are 8% takes 10hrs so as an average 1% takes 1.25 hrs, so as an average 100% will take 125hrs, or 5-6days

Shaun

 

by: hometech1Posted on 2009-11-06 at 07:06:14ID: 25759686

it just jumped to 10%...could this mean signs of life?

 

by: hometech1Posted on 2009-11-06 at 07:12:39ID: 25759764

heres why i think i need to do this....if any of you have entourage clients on exchange you will know that the stm file inflates to a crazy size.  because of the webdav/mapi problem
1. a defrag also brings that STM file down to normal.  
2. i have done alot of archiving lately and cleaning out old boxes and need to reclaim that space.  
3. i cant get calls every morning that the db has been dismounted like it was yesterday.

i have checked event 1221 and it says hi have 4 gb of space or more...I have several like that...at least 6 or 7 of these messages with that size.  how far back do i go to know how much space is available?  only 1 event, or keep adding them up to the last backup?

 

by: demazterPosted on 2009-11-06 at 07:20:08ID: 25759831

The latest event will tell you the latest White space.

If it's only 4GB then it's not been very usefull.

You need to set the retention period on deleted items as per my previous posts this will create more whitespace.

If there was whitespace available then the store would not have dusmounted unless it was at 79GB.

That's what I am trying to say if the files are 120GB and you have 50GB of whitespace the store will not dismount.

 

by: hometech1Posted on 2009-11-06 at 07:43:15ID: 25760044

i used to have the retention period at 30 and 60 days.  i changed them to 14 and 14 yesterday...how long does the transition take?

 

by: shauncroucherPosted on 2009-11-06 at 07:48:20ID: 25760095

The new retenton policy will run at the next online maintenance interval.

You should be pushing this to 0 as you have a critical spae issue. Push to 0, run online maintenance, check white space in 1221

Shaun

 

by: demazterPosted on 2009-11-06 at 08:17:27ID: 25760440

Also if you archived messages to PST this week then they will not fall into the 14 day period s as mentioned set them both to 0 and set the maintenance to run constantly (detailed in link I posted earlier) and this will produce whitespace straight away (within 15 minutes or so) which will stop the DB dismounting.

 

by: hometech1Posted on 2009-11-06 at 08:33:52ID: 25760597

if i add up all my mailboxes it is only about 45 gb...why would it only say 4gb white space?

 

by: demazterPosted on 2009-11-06 at 08:42:18ID: 25760692

Probably because it's in the dumpster.

Set the retention to 0 run the maintenance and then the whitespace should increase.

 

by: hometech1Posted on 2009-11-06 at 08:52:32ID: 25760790

up to 22%.  

 

by: shauncroucherPosted on 2009-11-06 at 08:54:13ID: 25760817

You do realise your database physical size after the defrag is going to be no more than 4gb smaller right? So if it is 78GB now, by the end of the defrag it will be maybe 74GB

Shaun

 

by: demazterPosted on 2009-11-06 at 09:22:47ID: 25761065

I did mention this is comment ID: 25759831 but didn't get a response.

 

by: shauncroucherPosted on 2009-11-06 at 09:40:42ID: 25761196

Sure, I was just reiterating...

Shaun

 

by: hometech1Posted on 2009-11-06 at 10:43:34ID: 25761806

Fellas i do truly appreciate your comments and help thus far.  I spoke to the client and we have decided to wait it out because now its up to 32%...13 hours into the defrag...and i dont want to have to restore the large backup where they won't have mail the rest of the day anyway.  So we are going to let it ride and when it finishes i will post here how long it took and what the results were.  

However, i did ask a question i wish someone could answer:
If i add up all my mailboxes it is only about 45GB...why would my database be much larger than that?

 

by: demazterPosted on 2009-11-06 at 11:33:26ID: 25762324

This could be the whitespace that would be created if the dumpster was emtied as per the deleted items retention settings.

Either way the physical size of the database is allways going to be different to the cumulatve size of your mailboxes because of this.

Please note the physical size if the database is not the limit of the store!  As per previos post the physical size of the database could be 100GB but the logical size could be less than 75GB

the database doesn't stretch and grow it just grows (much like an access database).

Only if you perform an offline defrag will you recover the space that is reported by event 1221

 

by: RancyPosted on 2009-11-08 at 21:58:09ID: 25773640

Single instance storage is also going to make the mailbox size not match the database size.  One message sent to multiple users is stored only one time in the database.  Each mailbox just has a pointer to that message, and the message is not deleted from the database until it has been deleted from all of the mailboxes.

The other information about the database requiring offline defrag to shrink, and not growing until all of the free space used in it is also correct.

Look in the application event log for event 1221 to tell you how much free space you have in the database.

 

by: hometech1Posted on 2009-11-09 at 15:42:01ID: 25781243

Here's a follow-up comment.  I really appreciate all your help everyone.  I let the defragmentation run for 24hrs straight.  At almost exactly the 24hr mark it was at 86% and then it had an error and started itself again. I dont know how that was possible since no one can be at the server and I was working on it remotely.  But anyway.  I let it run another few hours and again it was stuck at like 2% so I decided to end it.  I figured I would have to run isinteg to repair the database or restore my backup,.but I thought I would try to mount it just to see what would happen.  It mounted successfully!  I guess the original database was left untouched and it was writing all the changes to the temporary one.  I deleted the temp defragged database and left it back to how it it was before.  What a waste of a 24 hour period!  Jeez.  I am still where I was at the beginning.  I actually added up all my mailboxes and I actually have 32GB of data in the boxes, but my database says it is 58GB and STM file is 22GB. I still do not understand how there can be such a discrepancy.  I woulld love an explanation.  In the mean time I will split the points to the most helpful comments.

 

by: hometech1Posted on 2009-11-09 at 15:48:54ID: 31651007

I am only giving the grade of C because the solution was not really reached.  I mean I learned alot and thankfully I didnt lose any data or have to return to a backup but the objective wasntreally completed.

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...