• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 1567
  • Last Modified:

How do I quickly delete a large file on an Ext3 volume?

On a Ubuntu 8.04LTS box, I have some rather large files (100GB and larger) that I need to delete on a daily basis.  RM'ing the files take an inordinate amount of time.  Like in the minutes range.  Is there another method of deleting these large files that wouldn't take so long?
FYI, security isn't an issue in this particular matter, so we don't need to worry with wiping the disk, or anything.
Thanks in advance!
0
Digital_Skream
Asked:
Digital_Skream
  • 5
  • 5
  • 4
1 Solution
 
samieranaCommented:
Would you like to use the idea of adding a new Hard disk and use it to store the said data and instead of deleting just format that drive. it will not take much time. you can use script to do the work.
adding and formating help can be found here:
http://www.ehow.com/how_5068221_format-linux-hard-drives.html
0
 
Digital_SkreamAuthor Commented:
That isn't feasible in this case.  Logistics prevent such a path.
0
 
ravenplCommented:
There's no faster way, sorry. The filesystemhas to update it's on-disk structures, and it has to last - at least under ext3. Consider changing filesystem type.
0
Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

 
ravenplCommented:
If You don't need the space immediately freed, You could run the rm (unlink) in the background...
0
 
Digital_SkreamAuthor Commented:
Yah, I would need the space freed to create another file via script.
What would be a better filesystem?  I like the robustness of ext3, but the only drawback for me is the lengthy delete times required.  
0
 
samieranaCommented:
Using GUI is one way. It will immediate delete it but will go to Trash. Then you can empty trash later.
If you want your server not to be much busy during this deleting process you can use the following command:
ls | grep .| xargs rm
where "." is the name of the file/partial name of files.
0
 
Digital_SkreamAuthor Commented:
If it is in Trash, would the space be available for use?  Or would that just be like moving a file from one directory to another?
0
 
ravenplCommented:
large files? try ext4 with it's extents (ext3 has fixed extents of 4K size) - the smaller number of extents the faster file deletion.
0
 
ravenplCommented:
There's many webpages comparing filesystems performance
http://www.t2-project.org/zine/4/
http://linuxgazette.net/102/piszcz.html
But those tests are rather run on small files...
0
 
samieranaCommented:
space will not be available while files are in trash.
0
 
samieranaCommented:
Check this link out. if it works for you:
http://linux.die.net/man/1/fastrm
0
 
Digital_SkreamAuthor Commented:
Fastrm sounds very interesting, but I am unable to find the source/binaries/package anywhere for ubuntu.
0
 
ravenplCommented:
fastrm will not work for You. It's little faster when deleting large amount of files from single directory or directories tree.
for single large file it has to perform the same operations as regular rm.

fastrm used to be part of "inn" news server package - inn keeps very large number of small files - where fastrm was little faster...
0
 
Digital_SkreamAuthor Commented:
Then it sounds to me like I need to research a different filesystem, and that would be my only option.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Get your problem seen by more experts

Be seen. Boost your question’s priority for more expert views and faster solutions

  • 5
  • 5
  • 4
Tackle projects and never again get stuck behind a technical roadblock.
Join Now