We help IT Professionals succeed at work.

Cisco UCS Rack C-series servers networking using 10 Gb

Last Modified: 2014-09-10
Hello Experts,

We plan to refresh our VMware setup with 3 new Cisco UCS C240 M3 rack servers with VIC 1225 Dual Port 10Gb SFP+ and implement VMware Virtual SAN.

What is the best reasonabe way to connect them together using 10 Gbit? So far we used different server vendor and have little experience with UCS. Should we consider Nexus switches, fabric interconnects or just any other switches, which support 10 Gb? The idea is to keep it simple but Cisco UCS management looks interesting option.

The rest of network is 1Gb, based on Cisco 3750G swithches, which do not support 10 Gb.
Watch Question

James HIT Director

If you understand how to manage NXOS then go with the Nexus switches which are uplinked to Fabric Interconnect.  

NXOS is not the same an Cisco IOS and requires understanding in how to use and implement. UCS is very good, however configuration and setup of UCS is complicated and requires training and understanding.

This isn't the most "reasonable" (when it comes to price) but it keeps everything aligned with one vendor.


Would like to avoid NXOS learning as it would overcomlicate the setup without obvious benefits.

After further reading I understand we have 2 options:

Option1: Connect servers to pair of 6248 fabric interconnect so that servers have 10 Gbit connectivity. Use 1Gb aggregated uplinks to existing distribution switches. Plus we will be able to use UCS management via FI.

Option 2: Connect servers to pair of new switches, which support 10 Gb and then use uplinks to distribution switches.

Second solution would be easier to install and guess cheaper. Server management through individual CMI ports.

What switches can we use for second option? With enouhg SFP+ ports ...
IT Director
This one is on us!
(Get your first solution completely free - no credit card required)


10 Gb connectivity is required for VSAN traffic, which will go exclussively between 3 ESXi servers and will not hit uplinks, i.e. East/West.

All servers are virtual running in these 3 ESXi and uplinks will be loaded only with traffic generated by users, accessing servers. No VDI, not heavy.

Could you suggest a switch model? 3 servers will require only 3 ports from each switch.

Gain unlimited access to on-demand training courses with an Experts Exchange subscription.

Get Access
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Empower Your Career
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE

Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.


Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.