We're running into issues getting good network throughput on MySQL 5.0.20 cluster on FreeBSD 6.0 on a gigabit network (bge NICs).
Two FreeBSD machine host the cluster (dual 3.0ghz, 4gb ram, scsi), and several access it. When we do load testing, all the machines use less than 10% CPU. When accessing a local server however, the machine can use 100% CPU, leading us to the conclusion we're running in a network bottleneck somewhere.
When running ntop, network throughput is nowhere near 1000mbit/sec like we're supposed to be getting. Coming from a RH Linux environment, is FreeBSD not ready to utilize GigE out of the box? I've done a good bit of googling but couldn't turn up any solid answers.
Here are all the network parameters I could think of and their values:
Stack size is set to 256MB
The TCP connection between the cluster and accessing nodes is always established. For instance, when the accessing node runs a query, it runs it over an already established connection with the cluster.
Any ideas would be much appreciated!