Solved

Linux show's 138 GB of 145 Used but 0% disk space avilable

Posted on 2010-09-22
9
701 Views
Last Modified: 2013-12-16
I recently had a linux server where I ran out of disk space and wasn't able to get any services started. It's onthe LVM2 filesystem... I fixed the previous problems and was able to dump a few of the databases. However, now I've deleted more files and got over 7GB free. However, it says that there is 0% available. I have 138 out of 145 used but I don't have any disk space available.

Everytime I delete files it shows less being used but still none available.

I researched around and people told me it's because services are using the files etc etc... So I killed all the services and still nothing. so then I booted into a rescue CD and tried to delete files that way. But still nothing frees up.

Any suggestions or what I'm doing wrong?

I'm deleting folders with the rm -rf command.

Thanks a lot in advance.
0
Comment
Question by:keith_opswat
9 Comments
 
LVL 2

Expert Comment

by:mobilescholar
ID: 33737225
What output do the following commands produce?
df
free
0
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 33738464
Did you run fsck ?
0
 

Expert Comment

by:Ufomen
ID: 33739099
Hello!
It is the reserved space for root (by default 5%) in ext2 and ext3 volumes. For detailed information see explanation of -m  in man mke2fs

To check  reserved space"
tune2fs -l /dev/sda3
........
Block count:              4194973
Reserved block count:     209748
.......
0
Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

 
LVL 4

Expert Comment

by:ReN501
ID: 33812835
indeed ,  both the above experts are correct, to fre up some space temporarily , if your system isn't using the swap file , you can disable it for a quick fix ( although it is strongly recommaned if you dont have ram in your machine to support such a move , not to ) log files are bad for space also , deleting old or outdated logs or even moving them temporarily would also be a temp fix until you sort your space requirements out.
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33840286
I can't delete any files. And even though there are several gb free there is no usable space. I can't delete any files and Ive tried adding space to the volgroup through an external drive but it doesn't work. I can add space to boot but not / in the volume group. I've even booted into single user mode, rescue mode as well as some other bootable drive utilities. I've created a new swap file... I've added space to the existing swap file as well as disabled the swap file. I can delete files and it shows the used space getting lower, but the free space still stays at zero even though I've deleted several GB of data.

I have 300mb of memory free, 800mb free cache, and over 2gb worth of swap space free. I did a free -k command for that.

Df -h returns


[root@database botv2]# df -h
Filesystem                                             Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00     145G  144G     0 100% /
/dev/sda1                                              927M   13M  866M   2% /boot
none                                                      501M     0  501M   0% /dev/shm
/dev/hda                                                 76M   76M     0 100% /media/cdrom


A few days ago I had the Used space down to 137GB and still 0 available.

Any suggestions after receiving all this info?? I apologize for such a long delay in my response but I had a bunch of things come up. I was able to retrieve all the most vital information off this server but when I put it back up for everyone else to get files they need they started using the damn thing again and filled the space all the way up. Now I can't get any free space or anything...

Thanks for your time.
0
 
LVL 4

Accepted Solution

by:
ReN501 earned 500 total points
ID: 33841852
yeah , i'd say your into overhead territory.... basicall boot as single user , goto / and type "du -h"
minus the "" , this will give you the folders and folders sizes , navigate though to find whats taking up all the space and goto town , you need to free up space. its pretty much that simple.
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33842598
Yeh that's what I've been doing.. Going through with du -h --max-depth=1 and finding what I can get rid of. But like I said even though I was deleting like 10GB of stuff it never showed anymore free space.

So you're telling me Single User Mode should fix this? I will try it here in the next little bit and let you know how that works out for me.

Getting what I was able too off this server is amazing enough because originally even the Rescue CD couldn't detect a linux partition on the drive. I was able to completely rebuild the partitions and the filesystem with minimal loss... Just have had this issue because I have people here at work bugging me cause they want more stuff off there. EVen though the only reason the server filled up is because they did what I said not to do... And that was to run more Bot tests on our new software releases and fill up the drive with test results.

But thanks again... I hope your solution is the answer. Be back in a bit...
0
 
LVL 4

Expert Comment

by:ReN501
ID: 33842846
i'm saying linux using drive space really efficeiantly , 10gig might not be enough , backup save or delete more
 
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33874545
Nothing has worked... I'm done messing with this and closing. I appreciate all your attempts to help... This Linux server has been through a lot. It's possible when the filesystem went to hell and I rebuilt it something weird happened. I'm sure all your guys' info was correct, just wasn't gonna work on this one!!
0

Featured Post

Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Setting up Secure Ubuntu server on VMware 1.      Insert the Ubuntu Server distribution CD or attach the ISO of the CD which is in the “Datastore”. Note that it is important to install the x64 edition on servers, not the X86 editions. 2.      Power on th…
Join Greg Farro and Ethan Banks from Packet Pushers (http://packetpushers.net/podcast/podcasts/pq-show-93-smart-network-monitoring-paessler-sponsored/) and Greg Ross from Paessler (https://www.paessler.com/prtg) for a discussion about smart network …
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.

828 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question