How do I quickly delete a large file on an Ext3 volume?

On a Ubuntu 8.04LTS box, I have some rather large files (100GB and larger) that I need to delete on a daily basis.  RM'ing the files take an inordinate amount of time.  Like in the minutes range.  Is there another method of deleting these large files that wouldn't take so long?
FYI, security isn't an issue in this particular matter, so we don't need to worry with wiping the disk, or anything.
Thanks in advance!
LVL 1
Digital_SkreamAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

samieranaCommented:
Would you like to use the idea of adding a new Hard disk and use it to store the said data and instead of deleting just format that drive. it will not take much time. you can use script to do the work.
adding and formating help can be found here:
http://www.ehow.com/how_5068221_format-linux-hard-drives.html
0
Digital_SkreamAuthor Commented:
That isn't feasible in this case.  Logistics prevent such a path.
0
ravenplCommented:
There's no faster way, sorry. The filesystemhas to update it's on-disk structures, and it has to last - at least under ext3. Consider changing filesystem type.
0
CompTIA Cloud+

The CompTIA Cloud+ Basic training course will teach you about cloud concepts and models, data storage, networking, and network infrastructure.

ravenplCommented:
If You don't need the space immediately freed, You could run the rm (unlink) in the background...
0
Digital_SkreamAuthor Commented:
Yah, I would need the space freed to create another file via script.
What would be a better filesystem?  I like the robustness of ext3, but the only drawback for me is the lengthy delete times required.  
0
samieranaCommented:
Using GUI is one way. It will immediate delete it but will go to Trash. Then you can empty trash later.
If you want your server not to be much busy during this deleting process you can use the following command:
ls | grep .| xargs rm
where "." is the name of the file/partial name of files.
0
Digital_SkreamAuthor Commented:
If it is in Trash, would the space be available for use?  Or would that just be like moving a file from one directory to another?
0
ravenplCommented:
large files? try ext4 with it's extents (ext3 has fixed extents of 4K size) - the smaller number of extents the faster file deletion.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
ravenplCommented:
There's many webpages comparing filesystems performance
http://www.t2-project.org/zine/4/
http://linuxgazette.net/102/piszcz.html
But those tests are rather run on small files...
0
samieranaCommented:
space will not be available while files are in trash.
0
samieranaCommented:
Check this link out. if it works for you:
http://linux.die.net/man/1/fastrm
0
Digital_SkreamAuthor Commented:
Fastrm sounds very interesting, but I am unable to find the source/binaries/package anywhere for ubuntu.
0
ravenplCommented:
fastrm will not work for You. It's little faster when deleting large amount of files from single directory or directories tree.
for single large file it has to perform the same operations as regular rm.

fastrm used to be part of "inn" news server package - inn keeps very large number of small files - where fastrm was little faster...
0
Digital_SkreamAuthor Commented:
Then it sounds to me like I need to research a different filesystem, and that would be my only option.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Shell Scripting

From novice to tech pro — start learning today.