We are setting up a new HP P4300 SAN environment to use as shared storage for VMware ESXi 4.1. We have four storage nodes and two dedicated HP 2910al-24G ISCSI switches. The nodes are connected to the switches using a 1Gb NIC (also set as the SAN/IQ port) and two bonded 10Gb NICs. The hypervisors are connected using two 1Gb NICs, which are set up in for round-robin MPIO.
When running an IOMeter performance test, I see the performance of a drive on the SAN compared to a drive on local storage to be around a third to a sixth. For instance, the 512 byte 100% read, 0% random test shows 0.97MB/s on the SAN and 5.97MB/s on local storage. The 64K 100% read, 0% random test shows 36.30MB/s on the SAN and 222.60MB/s on local storage.
I have enabled jumbo frames end-to-end, and flow control on the SAN nodes and the switches. Is this an acceptable level of performance, or is there something else I can try to improve it?