VHDS performance issues
I am trying to set up a file server cluster using 2 VMs hosted on an S2D2019 cluster. Both compute and storage takes place on the S2D cluster.
I have create 2 vms FSC1 and FSC2, i have then created the cluster called FSC and created a file server called FSS.
On both VMsi have attached a shared VHDS also hosted on the S2D cluster.
I have tested speeds on the VMs C:\ drive using diskspd.exe and i can get over 3GB read and 1GB write running at 75/25 r/w with a 64kb file. no problems it works great. I have then tested copying large files from another location to the C drive and it gets around 700MB/s again no issues with this.
I then go to the drive hosted on the VHDs on the server that is hosting the storage and try to run diskspd.exe again. I get the message
"WARNING: Could not set valid file size (error code: 87); trying a slower method of filling the file (this does not affect performance, just makes the test preparation longer)"
After a while it comes back saying no reads and no writes. If i try to copy a file to this drive i get 10MB/s trying to copy using the share path and 30MB/s trying to copy using the local path.
Is there anything that could cause such pathetic performance? Maybe something i have missed? I created the VHDS on FSC1 and then attached it to FSC2.
Thanks in advance for any help and just let me know if you need anymore information.
I have create 2 vms FSC1 and FSC2, i have then created the cluster called FSC and created a file server called FSS.
On both VMsi have attached a shared VHDS also hosted on the S2D cluster.
I have tested speeds on the VMs C:\ drive using diskspd.exe and i can get over 3GB read and 1GB write running at 75/25 r/w with a 64kb file. no problems it works great. I have then tested copying large files from another location to the C drive and it gets around 700MB/s again no issues with this.
I then go to the drive hosted on the VHDs on the server that is hosting the storage and try to run diskspd.exe again. I get the message
"WARNING: Could not set valid file size (error code: 87); trying a slower method of filling the file (this does not affect performance, just makes the test preparation longer)"
After a while it comes back saying no reads and no writes. If i try to copy a file to this drive i get 10MB/s trying to copy using the share path and 30MB/s trying to copy using the local path.
Is there anything that could cause such pathetic performance? Maybe something i have missed? I created the VHDS on FSC1 and then attached it to FSC2.
Thanks in advance for any help and just let me know if you need anymore information.
Cliff Galiher
Dynamic example and ing VHDs could cause this as expanding the filemwouod necessarily change Metadata and force all writes through the coordinator node. Which on S2D, can be an even bigger penalty than shared storage. Also with S2D, the storage network is often a bottleneck. I've seen people trying to do hyper-converged but not properly segmenting storage or worse, putting storage and compute on the same network. Your network topologies may be at fault.
ASKER
I have 100Gb ROCEv2 setup and working for storage only completely segregated on 2 different VLANs.
For my compute I have Switch embedded team with 2x 10Gb adapters for each guest machine currently.
For my compute I have Switch embedded team with 2x 10Gb adapters for each guest machine currently.
StarWind rPerf for RDMA testing. It must be run per port. That's how we test.
What's the DiskSpd line please?
EDIT: And, are you trying to run it at the host level?
What's the DiskSpd line please?
EDIT: And, are you trying to run it at the host level?
ASKER
The issue does seem to be dynamically expanding.
The copy speed to a share on a dynamic expanding HVDS is 11.5MB/s
The copy speed to a share on a fixed size VHDS is over 700MB/s
Both shares / disks configured exactly the same other than dynamic / fixed.
Diskspd wont run from the dynamic expanding share still I get
"WARNING: Could not set valid file size (error code: 87); trying a slower method of filling the file (this does not affect performance, just makes the test preparation longer)"
On the fixed share I get MB 1884 total IOP/s 30150 using diskspd.exe -b64K -d10 -h -L -o8 -t8 -r -w30 -c2G io.dat
The copy speed to a share on a dynamic expanding HVDS is 11.5MB/s
The copy speed to a share on a fixed size VHDS is over 700MB/s
Both shares / disks configured exactly the same other than dynamic / fixed.
Diskspd wont run from the dynamic expanding share still I get
"WARNING: Could not set valid file size (error code: 87); trying a slower method of filling the file (this does not affect performance, just makes the test preparation longer)"
On the fixed share I get MB 1884 total IOP/s 30150 using diskspd.exe -b64K -d10 -h -L -o8 -t8 -r -w30 -c2G io.dat
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.