[Webinar] Learn how to a build a cloud-first strategyRegister Now

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 548
  • Last Modified:

How can I speed up my copying and moving huge files across my network

Good morning experts,

I have a simple one for you , but the solution has eluded me on my network at home. My problem is when I am copying or moving large files ( avg of 2.5 gib) files across my home network , I am only getting about 9 to 10 mb/s. how can I speed that up to at least 30 meg per second or more. I have checked the adaptors on all of my computers and they are capable of 10/100/1000 throughputs. I have each card configured as 100 or 1000 half duplex. my netgear hub ( its not a switch) is capable of 10/100/1000 throughputs. My computers are all Dell Optiplex computers with the exception to two machines. The Optiplex computers have integrated nics , but the other two pc clones have pci express nics in them. Is it a simple matter of going out and buying a better hub/switch and replacing/disabling my nics?
0
BLACK THANOS
Asked:
BLACK THANOS
  • 8
  • 6
  • 3
  • +3
4 Solutions
 
rhandelsCommented:
It seems that your network is only using a 100Mb connection. Did you check the NIC's what their connection speed is? Being capable of using 1GB connection does not automatically mean it is being used.  Because you get 10MB/s i don;t think you need to buy better hardware. You could loose some information while copying but not this slow.

Try setting the network connection to 1GB instead of auto select the speed, this might do the trick.
0
 
rhandelsCommented:
Also (but looking at the article you already guessed that) copying a large amount of small files takes more time than transferring 1 large file.
0
 
rindiCommented:
Get a gigabit switch, replace any 100MB NICs with 1GB NICs, and change the settings on your NICs to auto negotiate. Whenever you force a setting, you have to set the port on the switch to the same settings, and as hubs and cheap switches aren't managed, you can't change their settings.
0
Veeam and MySQL: How to Perform Backup & Recovery

MySQL and the MariaDB variant are among the most used databases in Linux environments, and many critical applications support their data on them. Watch this recorded webinar to find out how Veeam Backup & Replication allows you to get consistent backups of MySQL databases.

 
Mr TorturSystem EngineerCommented:
Hi Regis,

I suppose what you say is you are stuck to 10 MB/s (Megabytes, and not Mb/s for megabits).
I understand all your network cards are gigabit capable.
You could verify what you see in the network connection speed of all your computers, it could be of help if any network card has negociated another speed (10 or 100).
First did you check your network cables between hub and computers are gigabit capable?

Mr Tortur
0
 
John HurstBusiness Consultant (Owner)Commented:
I have each card configured as 100 or 1000 half duplex.   <-- Why?

Consider getting a Gigabit Switch (as has been noted above). I use 3-Com (was HP) and they are good.

Hook up both computers to your switch and then the switch to your network.

Don't forget that the machines will look to the source of DHCP (usually a router) for addressing and that can slow things down.

I have Cisco RV042G as my main router and it has Gigabit ports and is capable of 800Mbits / second throughput.

I have wired connections from it directly to my Desktop and to my Laptop (or I can use the Laptop with N wireless). Either way I get full 800Mbits / second transfer speed on large files (up to 50Gb).

A simple network with no extra connections will be your fastest.
0
 
BLACK THANOSAuthor Commented:
Thanks for all the input experts.
Yes, all of my cards are gigabit capable , that is if you all mean the 1000 in 10/100/1000 for each of my nics. As I don't have a router (except for my Comcast broadband modem) , all of my dhcp request are coming from that, but that is not the issue. I am getting great upload and download speeds from the INTERNET ( from 50 megabits/second bursting up to 150 ). I have no internet issues. I just want to copy files across my network between the 7 computers that I have on my peer to peer network.  My network is really simple ( you cant get much more simpler than peer to peer workgroups).

To my point, and I think it has been made by your wonderful feedback:

1.

All my cards are hard-coded as either 100  or 1000

2.

I need to verify this

3.

My Netgear hub is  10/100/1000

4.

Expert Hurst, you queried me as to why I have the cards set at 100 or 1000 half duplexthe only good answer is that I don't have a configurable switch to hard set at 1000 full duplex and my nics are set to
either 100 or 1000 and this needs to be fixed. I don't use auto negotiate because I don't have said Gigabit switch.

5.

Once I have purchased a Gigabit switch , I can then ensure that the communication from the switch to the computers are the same (preferably 1000 full duplex

Just to make sure that I am not assuming to much, when you say gigabit switch , you are referring to capabilities of a 1000base T correct Hurst???

!
0
 
John HurstBusiness Consultant (Owner)Commented:
Just to make sure that I am not assuming to much, when you say gigabit switch , you are referring to capabilities of a 1000base T correct Hurst???

Yes. I use a 3-Com as noted, the ports are autosensing, and my PC network cards are all 1000baseT (Gigabit) Full Duplex.
0
 
rindiCommented:
As I mentioned earlier, don't hard code your NIC's. When hardcoding your switch also has to be set to the same speed, and as you can't set any speed on your hub, that isn't possible. Just set them to auto negotiate, they will then run at the optimal speed.
0
 
Lee W, MVPTechnology and Business Process AdvisorCommented:
What model Netgear "hub" do you have?   Hubs haven't been used much (or sold much) in at least 15 years.  And a Gigabit hub was almost unheard of as far as I recall.  You may be mistaken, so please humor us and tell us the model of the Netgear "hub"
0
 
BLACK THANOSAuthor Commented:
Rindi, to your comment about hard coding nics. In one of my previous situations (jobs) , I found that auto-negotiating the nic cards did not cause the network to run at optimal speeds, because the system engineer that was responsible for setting ports in the network didn't always match the speeds on the computer , thereby causing havoc across the network.., so in fear, I have always hard coded, but I see the value of what you are saying and I control my little network here so , auto negotiating shouldn't be a problem.

Lee,
The model of my hub is: wait, wait, wait, I just turned the netgear hub over and its not a hub but a switch,
!
0
 
BLACK THANOSAuthor Commented:
Can I assume that it is not a manageable switch???
0
 
John HurstBusiness Consultant (Owner)Commented:
No, it is not a managed switch, just a plain switch.
0
 
BLACK THANOSAuthor Commented:
"I am only getting about 9 to 10 mb/s. how can I speed that up to at least 30 meg per second or more. I have checked the adaptors on all of my computers and they are capable of 10/100/1000 throughputs. "

Now that we have come full circle , my original request still stands. I want to get 30 megs per seconds and not the paltry 9 meg per seconds that I am currently getting across my peer to peer network. From your responses, I take it that the answer is yes , I can increase the throughput with my existing equipment.
0
 
BLACK THANOSAuthor Commented:
When you say plain switch, it makes me think that it is no better than a hub.
0
 
John HurstBusiness Consultant (Owner)Commented:
Check your speed directly at the modem to make sure it is delivering good speed. Then hook up only one device to the switch and do the same test. Are you getting the same speed?

Netgear is a consumer switch (likely to be) and may not have the throughput you want.
0
 
BLACK THANOSAuthor Commented:
Good to know
0
 
BLACK THANOSAuthor Commented:
Hi John,
I just performed at test. i disconnected two of my computers from the INTERNET and modem. I hard coded an iP address to both machines and connected them to the switch and wow, the 2.4 gig file that usually took 5 minutes to copy, took only 45 seconds. I guess I know what my bottleneck is now.
0
 
John HurstBusiness Consultant (Owner)Commented:
The other thing you might wish to do / know is to put a really fast router in front of your modem. Make the router the DHCP server also.

Now your network is isolated from the modem in terms of networking (you will still get internet of course).

Then hook up your main machines to the router, put a really fast switch on the router for other machines.  Your main machines should now give you top performance.

In short, you must engineer your network for top speed. It is unlikely to happen otherwise and it is not just a matter of ports.
0
 
BLACK THANOSAuthor Commented:
Great work John.
0
 
rindiCommented:
What you have is a switch, not a hub, but as mentioned above it isn't managed. So just change everything to autonegotiate.

When one side of the cable is hard coded, and the other isn't, then you run into problems. But unmanaged switches always use autonegotiate, so you must also use that on your NIC.

Something that can help is to use jumbo frames, but also there you should set all NICs to that in order for it to help.

https://en.wikipedia.org/wiki/Jumbo_frame
0
 
John HurstBusiness Consultant (Owner)Commented:
@REGISHYDE - Thank you and I was happy to help. Good luck with your network - I am very happy with how fast my own network works.
0

Featured Post

Veeam Disaster Recovery in Microsoft Azure

Veeam PN for Microsoft Azure is a FREE solution designed to simplify and automate the setup of a DR site in Microsoft Azure using lightweight software-defined networking. It reduces the complexity of VPN deployments and is designed for businesses of ALL sizes.

  • 8
  • 6
  • 3
  • +3
Tackle projects and never again get stuck behind a technical roadblock.
Join Now