We help IT Professionals succeed at work.

tar slow on NFS

c11v11
c11v11 asked
on
1,213 Views
Last Modified: 2014-01-21
We have many small files which stored on the NFS side. We want to tar the directory and then move these data to other NFS filesystem after two weeks. Now the problem is that the tar speed is very slow.One directory is 400M. It took 4 minutes to finish the tar command. We have many directories like this. It took a long time to tar all the files. We tested it on 3 servers and the time is almost same. If we move the data to other NFS filesystem, the tar time is reduced dramatically. But the data transferring time from filesystems also took a long time. What should I do ?
Comment
Watch Question

Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
CERTIFIED EXPERT
Top Expert 2007

Commented:
Check you system and the NFS server network cards speeds and mode. It could be a network interface / card settings issue.

Author

Commented:
we tested this tar command on different servers.  If my understanding is right, this should not work for my problem. We have two folders which are both mount at the NFS NAS. We need to tar one of the folders first and then move this tar file to another folder. The problem is that in that folder we have many small files, that took a long time to run the tar command. We really want to get a way to speed up the tar command.

Commented:
we tested this tar command on different servers.  If my understanding is right, this should not work for my problem.
Did you try this or did you assume it will not work?

Is the NAS box an actual computer with an operating system on it or one of those off-the-shelf drive sharing devices? If it is a computer, what operating system is it using? If not, then you are correct, it will probably not work and I should have asked my question in advance of the suggestion.

Author

Commented:
We are using EMC NAS. I just assume it.  I noticed that I must have another server to run that command # tar zcvf - /wwwdata | ssh root@dumpserver.nixcraft.in "cat > /backup/wwwdata.tar.gz"  Can I use the same server as I am running this command ?   what is the secret behind this  if this is working?   I will try to test it.  Thank you.

Commented:
The secret is that you must be able to ssh into the NAS device and execute the tar command via tunnel. I do not know the EMC product so you may just have to try it to know for certain.

Gain unlimited access to on-demand training courses with an Experts Exchange subscription.

Get Access
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Empower Your Career
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE

Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.