Solved

iSCSI - Offload or Jumbo Frames

Posted on 2013-10-24
5
1,151 Views
Last Modified: 2013-11-18
Dear Experts,

I have purchased a HP 530T card (1Gb), which is a hardware iSCSI card with TOE.
I planned to use the offload capability with jumbo frames but according to KB article 1007654

"You cannot use Jumbo Frames on a Broadcom card that is configured as a hardware initiator performing iSCSI Offload functions. You can either use Jumbo Frames or iSCSI Offload and you cannot use both together with the Broadcom adapters."

im not sure what config to go with

1) HP 530T Card HBA (switch off offload) and use jumbo frames
2) HP 530T Card HBA with offload but no jumbo frames.

Has anyone done any benchmark test with offload vs jumbo rames. Any advise on the route I should take?

Thanks in advanced
0
Comment
Question by:Rio_10
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 121
ID: 39596550
In our experience, we have found the "in-built" iSCSI Software Adaptor, and the use of Jumbo Frames outperforms Hardware iSCSI Initiators, which cannot use Jumbo Frames.

This would appear to be the general consensus.

http://www.vmadmin.co.uk/resources/35-esxserver/252-esxihwswiscsijumbo

If you have the ability to use Jumbo Frames it's always recommended to test, if your SAN, and Storage Switches support Jumbo Frames, and have enough buffer space in the physical switches to support such actions.

Mileage will vary, to say, your network and site, may be different to ours, and therefore we would recommend you conduct your own tests, and reach a conclusion.

On some configurations, we have seen jumbo frames, making performance worse.

Jumbo Frames can overcome read and write latencies, when the datastores are being maxed out.
0
 

Author Comment

by:Rio_10
ID: 39596662
Jumbo Frames can be used on hardware Initiators.

"Jumbo Frames for all iSCSI adapters in vSphere 5.1 and vSphere 5.5 can be configured using the UI. This applies to Software iSCSI,Dependent Hardware iSCSI and Independent Hardware iSCSI adapters"

I will test but it looks like i will disable the TOE and use jumbo frames. My switches also support jumbo Frames.

My storage has 8 ports, 4 on each controller. I have 4 ESXi HBA ports, I have read some conflicting info regarding 1:1 mapping.

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2038869

Do I configure the following

vSwitch1 - 192.168.0.1 --> Physical switch --> Controller 1 192.168.0.201
vSwitch2 - 192.168.1.1 --> Physical switch --> Controller 2 192.168.1.201
vSwitch3 - 192.168.2.1 --> Physical switch --> Controller 1 192.168.2.201
vSwitch4 - 192.168.3.1 --> Physical switch --> Controller 2 192.168.3.201

Physical switch --> Controller 1 192.168.0.202
Physical switch --> Controller 2 192.168.1.202
Physical switch --> Controller 1 192.168.2.202
Physical switch --> Controller 2 192.168.3.202
0
 
LVL 121

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 39596718
Not ALL iSCSI Hardware initiators, can do JF.

If you want to do multipath...

see my EE Articles

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

do you only have a single physical switch?
0
 

Author Comment

by:Rio_10
ID: 39596837
I have two Physical switches.
I read that How to but that means that all the iSCSI ports on the SAN (8 of them) neet to be on the same subnet.

This is where the conflict is. The SAN manufacturer state to use different subnets on its ports but but VMware states no too.

VMware states to use 1:1, one vSwitch to one pNic if its on different subnets.

or am I just being OTT. Shall I Just put all the host iSCSI and SAN ports on the same subnet
0
 
LVL 121
ID: 39597042
Same subnet or different subnets, depends how complex you want to make it, you will still have multiple paths to the Storage.
0

Featured Post

Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
Is your phone running out of space to hold pictures?  This article will show you quick tips on how to solve this problem.
Advanced tutorial on how to run the esxtop command to capture a batch file in csv format in order to export the file and use it for performance analysis. He demonstrates how to download the file using a vSphere web client (or vSphere client) and exp…
This Micro Tutorial steps you through the configuration steps to configure your ESXi host Management Network settings and test the management network, ensure the host is recognized by the DNS Server, configure a new password, and the troubleshooting…

717 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question