Solved

how to enabling high performance data transfer on redhat linux 4.2

Posted on 2011-09-21
9
260 Views
Last Modified: 2012-06-27
How to do Tuning of TCP for Linux 4.2 for maximizing data transfer over TCP
0
Comment
Question by:Seni
9 Comments
 

Author Comment

by:Seni
Comment Utility
We need to improve the transfer of data between 2 boxes located 1- in India the second location is Tanzania ( server running Redhat Linux 4.2)
0
 
LVL 38

Accepted Solution

by:
wesly_chen earned 500 total points
Comment Utility
It is more on network side instead of system side tuning.
So  far, the fastest data transfer protocol over TCP is FTP.

1. So use FTP to transfer data over internet/TCP is the fastest one.

2. Compress the data before transfer.
use bzip2, which has highest compress rate but longer compress time.
gzip is ok for both compress rate and time.

3. Use tar archives multiple files into one big file.
Transfer less big files is faster than transfer a lot of small files.
0
 
LVL 39

Expert Comment

by:noci
Comment Utility
I you have to repeat the transfer regularly please consider using rsync to transfer the data.

FTP is not secure by default, only if all parties concerned are setup to use SSL, (which pretty much gets ruined if NAT is involved somewhere), so it shouldn't be the first choice.

rsync might take longer the first time, but will only write updates afterwards.
0
 
LVL 38

Expert Comment

by:wesly_chen
Comment Utility
> FTP is not secure by default,
It depends on how do you use it.
Encrypt the file with "gpg" before transfer will improve the security.
In the internet, there is no such thing that is fully secure.
If the transfer speed is the highest priority, then use FTP with pre-encryption.
0
IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 
LVL 39

Expert Comment

by:noci
Comment Utility
FTP doesn't secure the password transfer, or if it does it might not be able to cross a NAT.
0
 
LVL 38

Expert Comment

by:wesly_chen
Comment Utility
> FTP doesn't secure the password transfer
agree. :->
0
 
LVL 40

Expert Comment

by:jlevie
Comment Utility
FTP of compressed data is the most efficient transfer protocol for this. But, since the username and password are transmitted in the clear in an FTP transaction the security implications may preclude that. The next best method would be SFTP. Since you can control all (or any) of the eintermediate hops in this transfer there is nothing to be gained bt tuning the TCP stacks on either end.
0
 
LVL 39

Expert Comment

by:noci
Comment Utility
rsync can do ssh encrypted transfers,  it also compresses all data on the fly, based on continually computed checksums over chunks of data if can notice that some data has been modified (sender->receiver only, independent if you are pushing or pulling).
In that case it will send only the modified data.

Because of this incremental property rsync can always continue where it left off if you need to disconenct/reconnect.
0
 
LVL 32

Expert Comment

by:harbor235
Comment Utility


Default IP stack parameters especially for large data file transfers are not optimal. In that case you may wnat to look at tunning your tcp and udp send and receive spaces.

Also, an IP statck can be tuned for predictable latency as well to maximize throughput.

harbor235 ;}
0

Featured Post

Threat Intelligence Starter Resources

Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

Join & Write a Comment

I have seen several blogs and forum entries elsewhere state that because NTFS volumes do not support linux ownership or permissions, they cannot be used for anonymous ftp upload through the vsftpd program.   IT can be done and here's how to get i…
The purpose of this article is to demonstrate how we can upgrade Python from version 2.7.6 to Python 2.7.10 on the Linux Mint operating system. I am using an Oracle Virtual Box where I have installed Linux Mint operating system version 17.2. Once yo…
Internet Business Fax to Email Made Easy - With eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, fr…
This video explains how to create simple products associated to Magento configurable product and offers fast way of their generation with Store Manager for Magento tool.

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now