Solved

RAID i/o performance

Posted on 1997-10-20
12
306 Views
Last Modified: 2013-12-16
Hiya...
Running Solaris 2.4 on Sparc-20.
We have a situation where our RAID array on sd8 which is Fast and Wide SCSI, is very very slow,
here is output from iostat.

#iostat -xtc
                                 extended disk statistics       tty         cpu
disk      r/s  w/s   Kr/s   Kw/s wait actv  svc_t  %w  %b  tin tout us sy wt id
sd15      0.2  5.2    0.2  237.4  0.0  0.1   19.9   0   9    0   96 19 25 52  4
sd16      0.0  0.0    0.0    0.0  0.0  0.0    0.0   0   0
sd17      0.2  6.2    0.6  346.9  0.0  0.2   33.6   0  21
sd3       1.8  0.0    8.0    0.0  0.0  0.0   14.0   0   3
sd8      17.2  9.4  577.7  292.4  1.8  2.3  156.2  62  85


##This is an entry in our /etc/system file
set ufs_ninode=5000
set ncsize=10000
set sd:sd_max_throttle=10
set scsi_options=0x178


Now heres the question.
Why does the Kr/s added to Kw/s not add up to the expected 20-40 megs per second. also what are the "set" options doing? and what impact do they have on the performance
of the Raid.
0
Comment
Question by:rickyr
12 Comments
 
LVL 1

Expert Comment

by:gabsi
ID: 1812721

The RAID is a secured solution, not a performant one.

Using RAID, the system has to compute parity bits each time it access disk.
It has also to distribute data on several disks when it writes, and
to read on several disks.
If your raid system has no memory cache, it can't be performant.
0
 
LVL 3

Author Comment

by:rickyr
ID: 1812722
Hiya...

The raid has 32mb memory cache. It is a 108gig unit. The speed of the i/o is very very low, and our RAID suppliers are looking into this for us.

Meanwhile could you answer the second part of the question, about the /etc/system file, Are the entries relevant to the RAID? What do they mean?
0
 

Expert Comment

by:wcarson
ID: 1812723
Your problem may be much deeper than this, but to achieve greater than 20 M bits a second transfer rates your SCSI cabbling must be
as short as possible. I have seen performance loss in cables as short as 1 1/2ft. With an array as large as yours, your cable may be pretty long.

Unfortunately, RAID problems can be very difficult to trace.
Chuck
0
Best Practices: Disaster Recovery Testing

Besides backup, any IT division should have a disaster recovery plan. You will find a few tips below relating to the development of such a plan and to what issues one should pay special attention in the course of backup planning.

 
LVL 3

Author Comment

by:rickyr
ID: 1812724
Hiya...
OK so the RAID problem may be a too deep to get into here. Our suppliers are looking into this for us anyway, so we'll forget about that. I'll bring up cable quality with them though, (Thanks for that).

Any ideas about the "sd" statements in the "etc/system" file. Do these have an impact on performance?

regards
0
 
LVL 3

Author Comment

by:rickyr
ID: 1812725
Hi...
We stripped out the set scsi options, and thru-put is now around 4 megs a second (sum of reads and writes). As we are getting closer to the solution, can anyone now state the correct scsi options to attain the full potential of the i/o (8-10 megs a second, I am told). This is a mission critical setup and we have a couple of running theories, so could anyone help here PDQ, before this solution is found by ourselve or our suppliers.
0
 
LVL 3

Author Comment

by:rickyr
ID: 1812726
Hiya...
Running theory no. 1& 2 were...
set scsi_option=0x100 and...
set scsi_option=0x200 but...
neither worked, they just took the i/o perf back to how it was in the first place.
regards

0
 
LVL 3

Author Comment

by:rickyr
ID: 1812727
err!...
I get the feelin, "ain't nobody here but us chickens"!
0
 

Expert Comment

by:john_jenkins
ID: 1812728
Yo
I've seen a similar problem where one (or both!) of the SCSI terminating resistor packs were wrongly fitted or missing - it's worth a check, tho' this does tend to give intermittent other SCSI faults (typically tape drives 'going away' until a reboot) as well. Also make sure there are no hardware configuration contention problems with your SCSI controller and another device - e.g. do you have a 2nd SCSI controller ?
Regards
0
 
LVL 3

Author Comment

by:rickyr
ID: 1812729
Hi...

Our RAID suppliers have sorted this out for us. We had to serial link into the RAID from a PC then enabled write cache and a the blocking size.

Thanks everyone
0
 
LVL 7

Accepted Solution

by:
linda101698 earned 100 total points
ID: 1812730
I'm posting the solution so it can be saved in the PAQ.

                          Our RAID suppliers have sorted this out for us. We had to serial link into the
                           RAID from a PC then enabled write cache and a the blocking size.
0
 
LVL 3

Author Comment

by:rickyr
ID: 1812731
Hi

Just to add.......

WARNING!!!!! Enabling write thru cache will corupt your data if there is a power outage, unless the RAID has an internal backup battery for it's cache'ing, or the whole system is on a UPS (Uninterupptable Power Supply). this is so that the data held in cache can be written back to disc.

regards
0
 
LVL 7

Expert Comment

by:linda101698
ID: 1812732
Thanks for adding the warning rickyr.
0

Featured Post

Master Your Team's Linux and Cloud Stack

Come see why top tech companies like Mailchimp and Media Temple use Linux Academy to build their employee training programs.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A metadevice consists of one or more devices (slices). It can be expanded by adding slices. Then, it can be grown to fill a larger space while the file system is in use. However, not all UNIX file systems (UFS) can be expanded this way. The conca…
Introduction Regular patching is part of a system administrator's tasks. However, many patches require that the system be in single-user mode before they can be installed. A cluster patch in particular can take quite a while to apply if the machine…
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:

831 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question