Solved

Rsync - no space left on device when there is.

Posted on 2013-01-17
11
2,137 Views
Last Modified: 2013-01-28
I’m trying to backup my VMs to external HDD for offsite backup.  I’m using a 1 TB drive, and seem to only have 932 GB of data.  I clear the drive with an rm  -rf * beforehand then run the following:

[root@openfiler external]#  rsync --progress -va /mnt/storage/nfs/ocl_nfs_1/backups /mnt/external --exclude=ESXi-2-VCSA/ --exclude=ESXi-2-VCSA_1 --delete | mail -s "RSync Job Log" tony@oceancontractors.ca

It runs for a while, then….

rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/mnt/external/backups/Antivirus/Antivirus-2013-01-17_04-00-03/Antivirus-flat.vmdk": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (179 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(635) [sender=3.0.3]

Running df –h against the USB drive shows me

/dev/sdc1             932G  289G  643G  31% /media/external

Running du -h against the source directory shows: 729G    /mnt/storage/nfs/ocl_nfs_1/backups

Am I missing some obvious RSYNC mystery, or is this a USB device too slow or something similar failure?
0
Comment
Question by:clicker666
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 5
11 Comments
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 38787724
Could it be that you hit your ulimit?

ulimit -f

to check.
0
 
LVL 14

Expert Comment

by:BlueCompute
ID: 38788487
Hard drive manufacturers count drive capacity in decimal bytes rather than binary bytes :(

http://en.wikipedia.org/wiki/Binary_prefix#Deviation_between_powers_of_1024_and_powers_of_1000

https://www.google.co.uk/search?q=1000000000000+bytes+in+Gigabytes

EDIT: sorry, misread the question...
0
 
LVL 1

Author Comment

by:clicker666
ID: 38788776
ulimited -f =unlimited. Darn, I was hoping it would be an easy thing.
0
Portable, direct connect server access

The ATEN CV211 connects a laptop directly to any server allowing you instant access to perform data maintenance and local operations, for quick troubleshooting, updating, service and repair.

 
LVL 68

Expert Comment

by:woolmilkporc
ID: 38788976
According to the rsync command you posted the target is "/mnt/external ", but the
drive /dev/sdc whose "df -h" you posted shows up as being mounted under "/media/external".

A typo? A mistake?
0
 
LVL 1

Author Comment

by:clicker666
ID: 38789023
No, I think you're on to something.  I'm not sure which one is the real external HDD.  I saw different files on each.
0
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 38789052
How can I help you finding it out?
0
 
LVL 1

Author Comment

by:clicker666
ID: 38789120
It appears I have both a /media/external and a mnt/external. Both are in different spots. I believe that /media/external is correct because I used the following command to setup the drive:  mount -type ntfs-3g /dev/sdc1 /media/external.  So, I'm not really sure where /mnt/external comes from.  To make matters more confusing I created a file inside of each and they're NOT the same place.  They're not subfolders.. I don't know where they are.
0
 
LVL 68

Accepted Solution

by:
woolmilkporc earned 500 total points
ID: 38789166
Seems that /mnt/external is just part of the root ( / ) filesystem and not on a volume of its own?
0
 
LVL 68

Assisted Solution

by:woolmilkporc
woolmilkporc earned 500 total points
ID: 38789183
cd /mnt/external
df .

What's in the last column?
0
 
LVL 1

Author Comment

by:clicker666
ID: 38789199
cd /mnt/external
df .
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda3             48860624   1939328  44315152   5% /


cd /media/external
[root@openfiler external]# df .
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sdc1            976760032    417412 976342620   1% /media/external

So it seems that the first one is on my big array and I have no idea why it's even there.  So /media/external is the real one.
0
 
LVL 1

Author Comment

by:clicker666
ID: 38827718
Just a quick follow up. I didn't have enough space on my USB hard drive to copy all my files.  I ended up writing a script that only selected the previous night's full backup.

My mount command turned out to be: mount -t ntfs-3g /dev/sdc1 /media/external.  This was initially quite confusing to me, as I accidentally kept writing /mnt/external in my backup command, which pointed to the wrong location.  I now understand how to mount and umount my external drives.  Thanks!
0

Featured Post

[Webinar] How Hackers Steal Your Credentials

Do You Know How Hackers Steal Your Credentials? Join us and Skyport Systems to learn how hackers steal your credentials and why Active Directory must be secure to stop them. Thursday, July 13, 2017 10:00 A.M. PDT

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Will try to explain how to use the VMware feature TAGs in the VMs and create Veeam Backup Jobs using TAGs. Since this article is too long, I will create second article for the Veeam tasks.
In this article, I will show you HOW TO: Suppress Configuration Issues and Warnings Alert displayed in Summary status for ESXi 6.5 after enabling SSH or ESXi Shell.
Teach the user how to rename, unmount, delete and upgrade VMFS datastores. Open vSphere Web Client: Rename VMFS and NFS datastores: Upgrade VMFS-3 volume to VMFS-5: Unmount VMFS datastore: Delete a VMFS datastore:
Teach the user how to use vSphere Update Manager to update the VMware Tools and virtual machine hardware version Open vSphere Client: Review manual processes for updating VMware Tools and virtual hardware versions: Create a new baseline group in vSp…

627 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question