We help IT Professionals succeed at work.

VSAN Test results

iFixedIT
iFixedIT asked
on
I have done some testing for our newly built VSAN 6. I used VMware I/O Analyzer to do testing. Its all flash Vsan environment and currently have 7 nodes in the cluster. when I did 4k_50read_100rand testing, I found that there are 5x more adapter reads/writes than VM reads/writes.Could it be that all the VSAN overhead is consuming that much bandwidth. I have attached my results.
4k-50read-14vms.docx
Comment
Watch Question

Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Did you complete the Health Checks in the Web Client, and is all well ?

Author

Commented:
All the 7 health tests passed in the web client.
Top Expert 2015

Commented:
vsan does mirroring of data between nodes.

Author

Commented:
yes I have ftt set to 2 and Raid-5/6 set for failure tolerance method.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
So what's your issue ?

Author

Commented:
when I did 4k_50read_100rand testing via VMware I/o analyzer, I found that there are 5x more adapter reads/writes than VM reads/writes.Could it be that all the VSAN overhead is consuming that much bandwidth
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Are your VMs and vSAN networking sharing the same nics ?

So you traffic is mixed between VM, and vSAN replication traffic.

replication between nodes, as was previously posted.

Author

Commented:
we have enabled nic portioning.  and using explicit failover order load balancing. active uplink0 and a standby uplink1 for VM port group. and then a active uplink1 and standby uplink0 for VSAN port group.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
have you looked at the stats using Ruby Console ?

Author

Commented:
yes I have. my only concern is that the results which I am getting is normal or am I missing something?
VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017
Commented:
Normal. vSAN is Cluster Storage e.g. replicated via your network via Multicast, hence why 10GBe is highly recommended, for fast replication, and resilience, on all local nodes, based on your storage policy selected.

Author

Commented:
thanks for the comments.