Solved

BackupExec 10d backups start fine, then slowdown

Posted on 2006-11-02
6
318 Views
Last Modified: 2010-04-03
I have a problem with the backup jobs slowing down when backing up data across the network.  

I can run a test backup( about 30gb of data) of a remote file server on the LAN, and the speed is okay( 800GB/sec) but this job slows down( 200GB/sec) when backing up some user folders.  Could the drive area where the user folders are located be so badly fragmented that it slows the backups down?

Not sure what else it could be,

WiReD
0
Comment
Question by:Rob Hutchinson
6 Comments
 
LVL 6

Accepted Solution

by:
davbouchard earned 300 total points
ID: 17860550
Not sure about your situation but if the data is contiguous or larger data files, the backups will go faster than if you were backing up many smaller files or files that are very fragmented.
0
 
LVL 55

Expert Comment

by:andyalder
ID: 17860614
If you're doing a test during the day it's likely that user files are open and if you're not using tha AOFO it's going to wait for each open file in case it can get a temporary lock on it. You can change how long it waits under the job properties.
0
 
LVL 2

Assisted Solution

by:davidcornes
davidcornes earned 100 total points
ID: 17865284
Do you always get this lower speed when backing up this data no matter when it's run (ie. day or night)? Also is the faster test backup to the same server, and what sort of data are you backing up when you run this?

Optimising backup performance can be something of a black art (so cauldron at the ready!), and many factors may need to be looked at:

Firstly as mentioned the time and load of the server needs to be considered, as you shop try avoid periods when it will be heavily loaded. CPU, disk and network activity will all have an effect on how well the remote backup agent can run and feed data to the backup server. Overnight/any time the server is lightly loaded will always give best results.

Fragmentation of the data being backed up will also have an influence as small or heavily fragmented files will be slower to read from disk than large contiguous ones.

As mentioned open files may also be causing wait-and-retry conditions, which will also of course slow down the backups.

The performance of the network *between* the remote server and the backup server shouldn't be overlooked either. If for instance bandwidth is limited at the time you're doing your user backups then this could restrict the data getting to the backup server. Also be aware that your backups may be having the same effect on other applications trying to use the network, so try be a good network citizen and to avoid conflicts.

Have a look into all of the above and see whether there are any areas that can be tweaked or modified.
0
Optimizing Cloud Backup for Low Bandwidth

With cloud storage prices going down a growing number of SMBs start to use it for backup storage. Unfortunately, business data volume rarely fits the average Internet speed. This article provides an overview of main Internet speed challenges and reveals backup best practices.

 
LVL 15

Assisted Solution

by:mcp_jon
mcp_jon earned 100 total points
ID: 17868181
Why don't you create a separate VLAN only for Network Traffic ??

That's what we have here, where I work, and we get very high speeds !

Best Regards !
0
 
LVL 19

Author Comment

by:Rob Hutchinson
ID: 17940242
Actually, we found out that the problem was due to extreme file framentation( defraging had not been done over a period of years) on the drive where the user folder was located.  The was also a problem with users storing there user profiles on this drive because these users were configured to store their terminal services profile info as well--some users had over 200 MB's of temp internet files...we deleted these and then ran a defrag which helped speed things up quite a bit.

Also looked into buying Diskeeper 2007 to manage the file framentation.  

Thanks for your help,

Sometimes it's easy to overlook the obvious.

WiReD
0
 
LVL 2

Expert Comment

by:davidcornes
ID: 17946633
Ah user profile bloat! That's worthy of a topic in itself ;-)

Glad you got it all sorted. For future backups you could maybe try excluding certain file types (eg. *.tmp, *.htm, *.jpg, *.mp3,  etc) so you're not wasting time and bandwidth backing up useless stuff.
0

Featured Post

New! My Passport Wireless Pro Wi-Fi Mobile Storage

Portable wireless storage to offload, edit, and stream anywhere.

High-capacity, wireless mobile storage designed to accompany professional photographers and videographers in the field to easily offload, edit and stream captured photos and high-definition videos.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Don't buy such-and-such disk drives, they are not reliable!    Boy, how many times have we read a post from a well-meaning person who had some bad experiences with a drive and now they exclaim the entire company's products can't be trusted.  First, …
Lets start to have a small explanation what is VAAI(vStorage API for Array Integration ) and what are the benefits using it. VAAI is an API framework in VMware that enable some Storage tasks. It first presented in ESXi 4.1, but only after 5.x sup…
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…

863 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now