Solved

Linux show's 138 GB of 145 Used but 0% disk space avilable

Posted on 2010-09-22
9
705 Views
Last Modified: 2013-12-16
I recently had a linux server where I ran out of disk space and wasn't able to get any services started. It's onthe LVM2 filesystem... I fixed the previous problems and was able to dump a few of the databases. However, now I've deleted more files and got over 7GB free. However, it says that there is 0% available. I have 138 out of 145 used but I don't have any disk space available.

Everytime I delete files it shows less being used but still none available.

I researched around and people told me it's because services are using the files etc etc... So I killed all the services and still nothing. so then I booted into a rescue CD and tried to delete files that way. But still nothing frees up.

Any suggestions or what I'm doing wrong?

I'm deleting folders with the rm -rf command.

Thanks a lot in advance.
0
Comment
Question by:keith_opswat
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
9 Comments
 
LVL 2

Expert Comment

by:mobilescholar
ID: 33737225
What output do the following commands produce?
df
free
0
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 33738464
Did you run fsck ?
0
 

Expert Comment

by:Ufomen
ID: 33739099
Hello!
It is the reserved space for root (by default 5%) in ext2 and ext3 volumes. For detailed information see explanation of -m  in man mke2fs

To check  reserved space"
tune2fs -l /dev/sda3
........
Block count:              4194973
Reserved block count:     209748
.......
0
Don't Cry: How Liquid Web is Ensuring Security

WannaCry is just the start. Read how Liquid Web is protecting itself and its customers against new threats.

 
LVL 4

Expert Comment

by:ReN501
ID: 33812835
indeed ,  both the above experts are correct, to fre up some space temporarily , if your system isn't using the swap file , you can disable it for a quick fix ( although it is strongly recommaned if you dont have ram in your machine to support such a move , not to ) log files are bad for space also , deleting old or outdated logs or even moving them temporarily would also be a temp fix until you sort your space requirements out.
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33840286
I can't delete any files. And even though there are several gb free there is no usable space. I can't delete any files and Ive tried adding space to the volgroup through an external drive but it doesn't work. I can add space to boot but not / in the volume group. I've even booted into single user mode, rescue mode as well as some other bootable drive utilities. I've created a new swap file... I've added space to the existing swap file as well as disabled the swap file. I can delete files and it shows the used space getting lower, but the free space still stays at zero even though I've deleted several GB of data.

I have 300mb of memory free, 800mb free cache, and over 2gb worth of swap space free. I did a free -k command for that.

Df -h returns


[root@database botv2]# df -h
Filesystem                                             Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00     145G  144G     0 100% /
/dev/sda1                                              927M   13M  866M   2% /boot
none                                                      501M     0  501M   0% /dev/shm
/dev/hda                                                 76M   76M     0 100% /media/cdrom


A few days ago I had the Used space down to 137GB and still 0 available.

Any suggestions after receiving all this info?? I apologize for such a long delay in my response but I had a bunch of things come up. I was able to retrieve all the most vital information off this server but when I put it back up for everyone else to get files they need they started using the damn thing again and filled the space all the way up. Now I can't get any free space or anything...

Thanks for your time.
0
 
LVL 4

Accepted Solution

by:
ReN501 earned 500 total points
ID: 33841852
yeah , i'd say your into overhead territory.... basicall boot as single user , goto / and type "du -h"
minus the "" , this will give you the folders and folders sizes , navigate though to find whats taking up all the space and goto town , you need to free up space. its pretty much that simple.
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33842598
Yeh that's what I've been doing.. Going through with du -h --max-depth=1 and finding what I can get rid of. But like I said even though I was deleting like 10GB of stuff it never showed anymore free space.

So you're telling me Single User Mode should fix this? I will try it here in the next little bit and let you know how that works out for me.

Getting what I was able too off this server is amazing enough because originally even the Rescue CD couldn't detect a linux partition on the drive. I was able to completely rebuild the partitions and the filesystem with minimal loss... Just have had this issue because I have people here at work bugging me cause they want more stuff off there. EVen though the only reason the server filled up is because they did what I said not to do... And that was to run more Bot tests on our new software releases and fill up the drive with test results.

But thanks again... I hope your solution is the answer. Be back in a bit...
0
 
LVL 4

Expert Comment

by:ReN501
ID: 33842846
i'm saying linux using drive space really efficeiantly , 10gig might not be enough , backup save or delete more
 
0
 
LVL 4

Author Comment

by:keith_opswat
ID: 33874545
Nothing has worked... I'm done messing with this and closing. I appreciate all your attempts to help... This Linux server has been through a lot. It's possible when the filesystem went to hell and I rebuilt it something weird happened. I'm sure all your guys' info was correct, just wasn't gonna work on this one!!
0

Featured Post

Stressed Out?

Watch some penguins on the livecam!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Join Greg Farro and Ethan Banks from Packet Pushers (http://packetpushers.net/podcast/podcasts/pq-show-93-smart-network-monitoring-paessler-sponsored/) and Greg Ross from Paessler (https://www.paessler.com/prtg) for a discussion about smart network …
Fine Tune your automatic Updates for Ubuntu / Debian
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question