how to enabling high performance data transfer on redhat linux 4.2

How to do Tuning of TCP for Linux 4.2 for maximizing data transfer over TCP
SeniAsked:
Who is Participating?

[Webinar] Streamline your web hosting managementRegister Today

x
 
wesly_chenConnect With a Mentor Commented:
It is more on network side instead of system side tuning.
So  far, the fastest data transfer protocol over TCP is FTP.

1. So use FTP to transfer data over internet/TCP is the fastest one.

2. Compress the data before transfer.
use bzip2, which has highest compress rate but longer compress time.
gzip is ok for both compress rate and time.

3. Use tar archives multiple files into one big file.
Transfer less big files is faster than transfer a lot of small files.
0
 
SeniAuthor Commented:
We need to improve the transfer of data between 2 boxes located 1- in India the second location is Tanzania ( server running Redhat Linux 4.2)
0
 
nociSoftware EngineerCommented:
I you have to repeat the transfer regularly please consider using rsync to transfer the data.

FTP is not secure by default, only if all parties concerned are setup to use SSL, (which pretty much gets ruined if NAT is involved somewhere), so it shouldn't be the first choice.

rsync might take longer the first time, but will only write updates afterwards.
0
Learn to develop an Android App

Want to increase your earning potential in 2018? Pad your resume with app building experience. Learn how with this hands-on course.

 
wesly_chenCommented:
> FTP is not secure by default,
It depends on how do you use it.
Encrypt the file with "gpg" before transfer will improve the security.
In the internet, there is no such thing that is fully secure.
If the transfer speed is the highest priority, then use FTP with pre-encryption.
0
 
nociSoftware EngineerCommented:
FTP doesn't secure the password transfer, or if it does it might not be able to cross a NAT.
0
 
wesly_chenCommented:
> FTP doesn't secure the password transfer
agree. :->
0
 
jlevieCommented:
FTP of compressed data is the most efficient transfer protocol for this. But, since the username and password are transmitted in the clear in an FTP transaction the security implications may preclude that. The next best method would be SFTP. Since you can control all (or any) of the eintermediate hops in this transfer there is nothing to be gained bt tuning the TCP stacks on either end.
0
 
nociSoftware EngineerCommented:
rsync can do ssh encrypted transfers,  it also compresses all data on the fly, based on continually computed checksums over chunks of data if can notice that some data has been modified (sender->receiver only, independent if you are pushing or pulling).
In that case it will send only the modified data.

Because of this incremental property rsync can always continue where it left off if you need to disconenct/reconnect.
0
 
harbor235Commented:


Default IP stack parameters especially for large data file transfers are not optimal. In that case you may wnat to look at tunning your tcp and udp send and receive spaces.

Also, an IP statck can be tuned for predictable latency as well to maximize throughput.

harbor235 ;}
0
All Courses

From novice to tech pro — start learning today.