Solved

NIC options for segregating iSCSI traffic?

Posted on 2011-03-24
11
584 Views
Last Modified: 2012-05-11
We have Dell Poweredge 2950, R510, and R710 servers. We want to use separate NICS for the iSCSI traffic to the servers than the LAN traffic. We need 2 of each (LAN and iSCSI) for HA.

I think the 2950 and R710 have 4 onboard NICs and the R510 has 2.

I've heard of iSCSI HBA's, regular gigabit NICs and then recently something about a TOE NIC which is kind of half way.

Any recommendations for which cards to buy? or if I should just use onboard NICs when possible? We don't anticipate booting from SAN but our CPU % utilization is above 70% quite often.

Thanks!
0
Comment
Question by:MrVault
  • 4
  • 3
  • 2
  • +1
11 Comments
 
LVL 9

Expert Comment

by:Chev_PCN
Comment Utility
It would depend on the kind of load you anticipate on your storage. If you need high-performance (e.g. big SQL databases with lots of I/O, then spend the extra for the HBA or TOE option. If it's for file storage / user data where speed is not so critical, then you can save money by using a standard GB NIC. You could also think about teaming for redundancy.
0
 

Author Comment

by:MrVault
Comment Utility
it's a big i/o sql server. what does a toe nic do that an hba doesn't? which one is recommended for dell servers?
0
 
LVL 9

Accepted Solution

by:
Chev_PCN earned 250 total points
Comment Utility
The options are not brand-specific, alhtough some companies may have their own branded options. HPO is one.
TOE is a NIC with a TCP/IP Offload Engine, which takes all the TCP/IP processing off the CPU and onto the NIC. The iSCSI HBA is an all-in-one NIC with TOE AND a HW initiator. For a big SQL server, go with the HBA - it will give you the best performance. I'm not sure, but I think they're around US$400. Again, think about redundancy if it's a mission-critical server.
0
 
LVL 42

Assisted Solution

by:kevinhsieh
kevinhsieh earned 250 total points
Comment Utility
Before you go out and buy stuff, do you know that the CPU utilization is related to iSCSI? You can start by looking at task manager and compare the SQL Server processor utilization compared to the total. If SQL is most of your CPU I don't think that a ToE or HBA is going to help much.

Are you using jumbo frames? If not you should turn them on for your iSCSI NICs, switch ports, and SAN. That can really reduce the CPU associated with I/O.

All of your servers have ToE capable LOMs. Check with Dell tech support about getting them activated at both the hardware and OS level.

Finally, adding RAM can usually reduce the I/O requirements of SQL, which would improve performance and reduce I/O related CPU utilization.

Alacratech was big in the iSCSI HBA market a few years ago when people thought that software iSCSI initiators were too risky. They were pretty pricy, like north of $1000 as I recall. I have no idea what the market is like now.
0
 

Author Comment

by:MrVault
Comment Utility
jumbo frames are on across the board. the servers are either maxed out on ram or it will cost $2000 to upgrade the ram. we're using 16GB chips, so we have to buy in pairs which is $1000 per.
0
IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 
LVL 42

Expert Comment

by:kevinhsieh
Comment Utility
I would call Dell Tech support and ask them to help you with enabling ToE on your Broadcom LOMs. It's quite possible that you already have it as it's pretty much a default option when buying them. They also may be upgradeable to iSCSI offload. I would talk to your Dell server rep. It looks like Alacritech got out of the iSCSI HBA business, and that QLogic is still making stand alone cards.

You maxed out an R710 on RAM? That's 144 GB with 8 GB chips, and 288 GB with 16 GB chips. I am jealous.

0
 

Author Comment

by:MrVault
Comment Utility
no. we maxed out the 2950's. the r710's are not maxed out. we have 8x8gb. but it's not cheap to buy 2 more 8gb chips. the R510's are 4x16GB and even more expensive to buy 2x16GB chips to grow.

does TOE take the CPU part out of the CPU?
0
 
LVL 42

Expert Comment

by:kevinhsieh
Comment Utility
ToE takes part of the CPU out. The CPU still needs to process iSCSI, but it takes off processing related to TCP/IP traffic.

http://en.wikipedia.org/wiki/Tcp_offload_engine
0
 

Author Comment

by:MrVault
Comment Utility
thanks. maybe we'll try toe first and see how it preforms before buying hba's across the board.
0
 
LVL 68

Expert Comment

by:Qlemo
Comment Utility
This question has been classified as abandoned and is closed as part of the Cleanup Program. See the recommendation for more details.
0

Featured Post

Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

Join & Write a Comment

More or less everybody in the IT market understands the basics of Networking, however when we start talking about Storage Networks, things get a bit dizzier, and this is where I would like to help.
Learn about cloud computing and its benefits for small business owners.
This tutorial will give a an overview on how to deploy remote agents in Backup Exec 2012 to new servers. Click on the Backup Exec button in the upper left corner. From here, are global settings for the application such as connecting to a remote Back…
To efficiently enable the rotation of USB drives for backups, storage pools need to be created. This way no matter which USB drive is installed, the backups will successfully write without any administrative intervention. Multiple USB devices need t…

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now