Backup Exec and millions of small files
Posted on 2006-06-29
We have Symantec Backup Exec 10d, an LTO tape library, a server &l disk array and a Gigabit network.
We have two servers each with over two million small files, across fifty thousand directories on a single NTFS volume. The files total about 250GB on each server.
Files are read-only with approx. 10,000 new files added every weekday.
Backup of this volume achieves a reported throughput of 200MB/Min as opposed to the over 1GB/Min we achieve on Exchange or SQL database files.
More importantly it takes over eighteen hours to perform a full backup.
So how do we achieve a small backup windows and faster backup?
The files need to be held off-site so currently they are written to tape, and not just another disk array.
Using BackupExec options can will improve the performance?
Do we now need to consider flash snapshot and mirroring options to reduce the windows?
Or should we use replication to copy them to a remote office?
And would either or these help get the files onto tape more quickly?
Answers based on actual experience using Symantec / Veritas solutions are preferred as we have alot of installed product from this software house.