SeeDk
asked on
ESXI 6.0 - Intel PCIe SSD performing very slowly
Purchased this PCIe SSD for a PowerEdge R740xd running ESXI 6.0 expecting to see the 500k IOPS advertised:
https://www.intel.com/content/www/us/en/products/memory-storage/solid-state-drives/gaming-enthusiast-ssds/optane-900p-series/900p-480gb-aic-20nm.html
This is being allocated to two RHEL7 VMs.
However, when running fio and ioping I can see that the IOPS only reach around 120k for random read/writes.
This slower than expected speed first became apparent when the database used on the server did not perform any better using this SSD than it did on 15K HDDs.
I've been talking with our vendor about this but they are not sure what the issue is.
Digging around on VMware's site I find this:
https://my.vmware.com/group/vmware/details?downloadGroup=DT-ESX60-INTEL-NVME-1209&productId=491
Is this the install that's needed to get these PCIe to function as advertised?
Has anyone else here seen this issue with these PCIe SSDs?
Will installing this have any negative effect on the hard disks already in use by the server?
https://www.intel.com/content/www/us/en/products/memory-storage/solid-state-drives/gaming-enthusiast-ssds/optane-900p-series/900p-480gb-aic-20nm.html
This is being allocated to two RHEL7 VMs.
However, when running fio and ioping I can see that the IOPS only reach around 120k for random read/writes.
This slower than expected speed first became apparent when the database used on the server did not perform any better using this SSD than it did on 15K HDDs.
I've been talking with our vendor about this but they are not sure what the issue is.
Digging around on VMware's site I find this:
https://my.vmware.com/group/vmware/details?downloadGroup=DT-ESX60-INTEL-NVME-1209&productId=491
Is this the install that's needed to get these PCIe to function as advertised?
Has anyone else here seen this issue with these PCIe SSDs?
Will installing this have any negative effect on the hard disks already in use by the server?
ASKER CERTIFIED SOLUTION
THIS SOLUTION IS ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
SOLUTION
THIS SOLUTION IS ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
Please note that your I/O is VIRTUALIZED, this is not a bare metal I/O TEST.
e.g. it's a VMDK on a datastore with a PCIe SSD card!
So getting advertised speeds - NO!
e.g. it's a VMDK on a datastore with a PCIe SSD card!
So getting advertised speeds - NO!
ASKER
Ok, makes sense. What is a realistic expectation? 10-15% decrease from advertised speeds?
ASKER
So I installed an Intel® Optane™ SSD DC P4800X Series SSDPED1K375GA (375 GB, HHHL AIC) which is on the VMWare HCL.
Downloaded the drivers and installed them.
Still, the speed I am getting is abysmal. It is an improvement but only marginally.
The HDDs in this system are benchmarking random read/write speeds of 89.9k/30.0k
The PCIe NVMe SSD is benchmarking at 123k/41.1k.
Not even twice as fast! Aren't NVMe SSD's supposed to have close to 3x the performance of HDDs?
And the latency is horrible...it is showing an average of 884.1us.
Is this expected with VMware??
Downloaded the drivers and installed them.
Still, the speed I am getting is abysmal. It is an improvement but only marginally.
The HDDs in this system are benchmarking random read/write speeds of 89.9k/30.0k
The PCIe NVMe SSD is benchmarking at 123k/41.1k.
Not even twice as fast! Aren't NVMe SSD's supposed to have close to 3x the performance of HDDs?
And the latency is horrible...it is showing an average of 884.1us.
Is this expected with VMware??
SOLUTION
THIS SOLUTION IS ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
ASKER
Yes, I understand I won't ever get the advertised speeds on VMware.
I can understand a 10% or 20% reduction but this is a 64% decrease! This is normal?
I can understand a 10% or 20% reduction but this is a 64% decrease! This is normal?
Depends on the card in use, and how it's used.
Linux
Linux is a UNIX-like open source operating system with hundreds of distinct distributions, including: Fedora, openSUSE, Ubuntu, Debian, Slackware, Gentoo, CentOS, and Arch Linux. Linux is generally associated with web and database servers, but has become popular in many niche industries and applications.
71K
Questions
--
Followers
--
Top Experts
Get a personalized solution from industry experts
TRUSTED BY
ASKER
No, it is not on the compatibility list..so I guess this is the main problem.
I will get one that is on the compatibility list, install the drivers and try again. But will these still perform close to advertised speeds or is some slowdown expected on VMware?