Go Premium for a chance to win a PS4. Enter to Win

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 287
  • Last Modified:

how to enabling high performance data transfer on redhat linux 4.2

How to do Tuning of TCP for Linux 4.2 for maximizing data transfer over TCP
0
Seni
Asked:
Seni
1 Solution
 
SeniAuthor Commented:
We need to improve the transfer of data between 2 boxes located 1- in India the second location is Tanzania ( server running Redhat Linux 4.2)
0
 
wesly_chenCommented:
It is more on network side instead of system side tuning.
So  far, the fastest data transfer protocol over TCP is FTP.

1. So use FTP to transfer data over internet/TCP is the fastest one.

2. Compress the data before transfer.
use bzip2, which has highest compress rate but longer compress time.
gzip is ok for both compress rate and time.

3. Use tar archives multiple files into one big file.
Transfer less big files is faster than transfer a lot of small files.
0
 
nociSoftware EngineerCommented:
I you have to repeat the transfer regularly please consider using rsync to transfer the data.

FTP is not secure by default, only if all parties concerned are setup to use SSL, (which pretty much gets ruined if NAT is involved somewhere), so it shouldn't be the first choice.

rsync might take longer the first time, but will only write updates afterwards.
0
Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 
wesly_chenCommented:
> FTP is not secure by default,
It depends on how do you use it.
Encrypt the file with "gpg" before transfer will improve the security.
In the internet, there is no such thing that is fully secure.
If the transfer speed is the highest priority, then use FTP with pre-encryption.
0
 
nociSoftware EngineerCommented:
FTP doesn't secure the password transfer, or if it does it might not be able to cross a NAT.
0
 
wesly_chenCommented:
> FTP doesn't secure the password transfer
agree. :->
0
 
jlevieCommented:
FTP of compressed data is the most efficient transfer protocol for this. But, since the username and password are transmitted in the clear in an FTP transaction the security implications may preclude that. The next best method would be SFTP. Since you can control all (or any) of the eintermediate hops in this transfer there is nothing to be gained bt tuning the TCP stacks on either end.
0
 
nociSoftware EngineerCommented:
rsync can do ssh encrypted transfers,  it also compresses all data on the fly, based on continually computed checksums over chunks of data if can notice that some data has been modified (sender->receiver only, independent if you are pushing or pulling).
In that case it will send only the modified data.

Because of this incremental property rsync can always continue where it left off if you need to disconenct/reconnect.
0
 
harbor235Commented:


Default IP stack parameters especially for large data file transfers are not optimal. In that case you may wnat to look at tunning your tcp and udp send and receive spaces.

Also, an IP statck can be tuned for predictable latency as well to maximize throughput.

harbor235 ;}
0

Featured Post

What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now