Solved

iSCSI - Offload or Jumbo Frames

Posted on 2013-10-24
5
1,133 Views
Last Modified: 2013-11-18
Dear Experts,

I have purchased a HP 530T card (1Gb), which is a hardware iSCSI card with TOE.
I planned to use the offload capability with jumbo frames but according to KB article 1007654

"You cannot use Jumbo Frames on a Broadcom card that is configured as a hardware initiator performing iSCSI Offload functions. You can either use Jumbo Frames or iSCSI Offload and you cannot use both together with the Broadcom adapters."

im not sure what config to go with

1) HP 530T Card HBA (switch off offload) and use jumbo frames
2) HP 530T Card HBA with offload but no jumbo frames.

Has anyone done any benchmark test with offload vs jumbo rames. Any advise on the route I should take?

Thanks in advanced
0
Comment
Question by:Rio_10
  • 3
  • 2
5 Comments
 
LVL 118
ID: 39596550
In our experience, we have found the "in-built" iSCSI Software Adaptor, and the use of Jumbo Frames outperforms Hardware iSCSI Initiators, which cannot use Jumbo Frames.

This would appear to be the general consensus.

http://www.vmadmin.co.uk/resources/35-esxserver/252-esxihwswiscsijumbo

If you have the ability to use Jumbo Frames it's always recommended to test, if your SAN, and Storage Switches support Jumbo Frames, and have enough buffer space in the physical switches to support such actions.

Mileage will vary, to say, your network and site, may be different to ours, and therefore we would recommend you conduct your own tests, and reach a conclusion.

On some configurations, we have seen jumbo frames, making performance worse.

Jumbo Frames can overcome read and write latencies, when the datastores are being maxed out.
0
 

Author Comment

by:Rio_10
ID: 39596662
Jumbo Frames can be used on hardware Initiators.

"Jumbo Frames for all iSCSI adapters in vSphere 5.1 and vSphere 5.5 can be configured using the UI. This applies to Software iSCSI,Dependent Hardware iSCSI and Independent Hardware iSCSI adapters"

I will test but it looks like i will disable the TOE and use jumbo frames. My switches also support jumbo Frames.

My storage has 8 ports, 4 on each controller. I have 4 ESXi HBA ports, I have read some conflicting info regarding 1:1 mapping.

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2038869

Do I configure the following

vSwitch1 - 192.168.0.1 --> Physical switch --> Controller 1 192.168.0.201
vSwitch2 - 192.168.1.1 --> Physical switch --> Controller 2 192.168.1.201
vSwitch3 - 192.168.2.1 --> Physical switch --> Controller 1 192.168.2.201
vSwitch4 - 192.168.3.1 --> Physical switch --> Controller 2 192.168.3.201

Physical switch --> Controller 1 192.168.0.202
Physical switch --> Controller 2 192.168.1.202
Physical switch --> Controller 1 192.168.2.202
Physical switch --> Controller 2 192.168.3.202
0
 
LVL 118

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 500 total points
ID: 39596718
Not ALL iSCSI Hardware initiators, can do JF.

If you want to do multipath...

see my EE Articles

HOW TO: Add an iSCSI Software Adaptor and Create an iSCSI Multipath Network in VMware vSphere Hypervisor ESXi 5.0

do you only have a single physical switch?
0
 

Author Comment

by:Rio_10
ID: 39596837
I have two Physical switches.
I read that How to but that means that all the iSCSI ports on the SAN (8 of them) neet to be on the same subnet.

This is where the conflict is. The SAN manufacturer state to use different subnets on its ports but but VMware states no too.

VMware states to use 1:1, one vSwitch to one pNic if its on different subnets.

or am I just being OTT. Shall I Just put all the host iSCSI and SAN ports on the same subnet
0
 
LVL 118
ID: 39597042
Same subnet or different subnets, depends how complex you want to make it, you will still have multiple paths to the Storage.
0

Featured Post

Best Practices: Disaster Recovery Testing

Besides backup, any IT division should have a disaster recovery plan. You will find a few tips below relating to the development of such a plan and to what issues one should pay special attention in the course of backup planning.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When we have a dead host and we lose all connections to the ESXi, and we need to find a way to move all VMs from that dead ESXi host.
Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
Teach the user how to install log collectors and how to configure ESXi 5.5 for remote logging Open console session and mount vCenter Server installer: Install vSphere Core Dump Collector: Install vSphere Syslog Collector: Open vSphere Client: Config…
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…

943 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

6 Experts available now in Live!

Get 1:1 Help Now