Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

sysbench slow performance of new 18 disk raid 1+0

Posted on 2009-03-31
6
1,343 Views
Last Modified: 2013-11-14
We have recently purchased the following hardware.
HP DL380 8cores 32GB 2x72 10k sas drives
HP MSA70 array with 18 sas 146 10K dives

We upgrading our MYSQL database hardware.  I have the array configured  the array as a 18 disk raid 10 with 100 write cache on.

I am running the following sysbench test:

sysbench --test=fileio --init-rng=1 --file-total-size=8G --file-num=4 --max-time=120 --max-requests=10000000 --file-rw-ratio=1.5 --file-fsync-freq=on  --file-test-mode=rndwr --file-extra-flags=direct --num-threads=32 prepare

sysbench --test=fileio --init-rng=1 --file-total-size=8G --file-num=4 --max-time=120 --max-requests=10000000 --file-rw-ratio=1.5 --file-fsync-freq=on  --file-test-mode=rndwr --file-extra-flags=direct --num-threads=32 run

And getting the flowing results:
18disks raid10 Read 0b  Written 9.9037Gb  Total transferred 9.9037Gb (84.467Mb/sec)    5405.88 Requests/sec executed

I get 5400 random writes per second on the 18 disks raid 10.  Our dba is saying that he is getting 10K on a 4 disk raid10.  I believe  I am getting the correct performance out of this array. But I do not have a real base line.  I am looking for benchmarks of similar systems `16-20 disk raid 10 with the same sysbench command I ran above.

I am also looking for any configuration problems that would lead to 4disks running 2 times as fast as 18 disks.
Thank You
Martin

0
Comment
Question by:martin_2110
  • 3
  • 3
6 Comments
 
LVL 55

Accepted Solution

by:
andyalder earned 500 total points
ID: 24037490
5400 IOPS sounds pretty good to me, 600 IOPS per disk so some is being met from cache - you'll get about 170 IOPS per disk at a push. Not sure how he's getting 10K IOPS on 4 disks, that's 5000 IOPS for a single disk which is clearly impossible so it has to be coming from RAM. It can't even be coming from controller battery backed RAM if you are using an 8GB file size since there aren't any PCI controllers with that much RAM on them.

Not sure how rndwr and file-rw-ratio act in combination, I guess it ignores file-rw-ratio.
0
 
LVL 7

Author Comment

by:martin_2110
ID: 24041824
Thanks andy. Do you know a good benchmark that will defeat caching? I would like a linux benchmark to give me the actual IOPS per drive?
0
 
LVL 7

Author Comment

by:martin_2110
ID: 24041845
Far as the file-rw-ratio it is ignored.
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 55

Expert Comment

by:andyalder
ID: 24043135
Not really a Linux engineer but I presume you can do the same as I do using IOmeter for Windows. Partition the drive into a number of slices (say 20 of them) and then run 20 seperate instances of sysbench each using a file on its own partition. This defeats the cache fairly well because instead of an single 8GB file there are 20 * 8GB files spread across the disk. It also forces long seeks; your developer might be using big SATA disks in his PC and you can almost get 8GB on a single track on the outside of the platter. You'd obviously have to drop num-threads down to one per instance.

If he is using big SATAs then get him to run the tests for an hour or so, they go into write-verify mode when they get hot which really slows them down. Your little SAS disks are designed for 100% duty cycle so they don't slow down like that.
0
 
LVL 7

Author Closing Comment

by:martin_2110
ID: 31565045
Thank you.
0
 
LVL 55

Expert Comment

by:andyalder
ID: 24043481
Thanks :)

I'd like to see the results of re-running the tests on the two arrays so will be grateful if you can post them sfter re-running. If nothing else it will help others because as you must have observed, there aren't many publically accessible benchmarks out there.
0

Featured Post

Portable, direct connect server access

The ATEN CV211 connects a laptop directly to any server allowing you instant access to perform data maintenance and local operations, for quick troubleshooting, updating, service and repair.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
How to create SAN for end users 9 48
Linux FTP Error 5 33
Setup Ubuntu 16.04 to use LDAP for user login and authentication 2 80
VMware vSAN 6.5 usage example and caveats 11 82
Learn about cloud computing and its benefits for small business owners.
This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

861 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question