Question

High Server Load

Asked by: Andy1988

Hello,

I'm facing a high server load on my CentOS server.

Below is the output of 'top'. Need help ASAP.

12075 root      20   0  2460 1204  796 R  0.7  0.1   0:00.54 top
 4225 mailman   20   0 10212 5956 2428 S  0.3  0.3   0:01.02 python2.4
11366 nobody    20   0 26884  11m 1652 S  0.3  0.6   0:00.07 httpd
11841 nobody    20   0 26884  11m 1652 S  0.3  0.6   0:00.03 httpd
13078 nobody    20   0 26880  10m  528 D  0.3  0.5   0:00.01 httpd
    1 root      20   0  2064  620  536 S  0.0  0.0   0:00.98 init
    2 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 kthreadd
    3 root      RT  -5     0    0    0 S  0.0  0.0   0:00.07 migration/0
    4 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 ksoftirqd/0
    5 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/0
    6 root      RT  -5     0    0    0 S  0.0  0.0   0:00.07 migration/1
    7 root      15  -5     0    0    0 S  0.0  0.0   0:00.04 ksoftirqd/1
    8 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/1
    9 root      RT  -5     0    0    0 S  0.0  0.0   0:00.14 migration/2
   10 root      15  -5     0    0    0 S  0.0  0.0   0:00.02 ksoftirqd/2
   11 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/2
   12 root      RT  -5     0    0    0 S  0.0  0.0   0:00.10 migration/3
   13 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/3
   14 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/3
   15 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 cpuset
   16 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 events/0
   17 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 events/1
   18 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 events/2
   19 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 events/3
   20 root      15  -5     0    0    0 S  0.0  0.0   0:00.12 work_on_cpu/0
   21 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/1
   22 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/2
   23 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/3
   24 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 khelper
   27 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 netns
  165 root      15  -5     0    0    0 S  0.0  0.0   0:00.13 kblockd/0
  166 root      15  -5     0    0    0 S  0.0  0.0   0:00.28 kblockd/1
  167 root      15  -5     0    0    0 S  0.0  0.0   0:00.63 kblockd/2
  168 root      15  -5     0    0    0 S  0.0  0.0   0:00.06 kblockd/3
  169 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kacpid
  170 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kacpi_notify
  229 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 cqueue
  233 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 ata/0
  234 root      15  -5     0    0    0 S  0.0  0.0   0:00.02 ata/1
  235 root      15  -5     0    0    0 S  0.0  0.0   0:00.02 ata/2
  236 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 ata/3
  237 root      15  -5     0    0    0 D  0.0  0.0   0:00.09 ata_aux
  238 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 ksuspend_usbd
  244 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 khubd
  247 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kseriod

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:

Select all Open in new window

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

Plus...

30 Day FREE access, no risk, no obligation
Collaborate with the world's top tech experts
Unlimited access to our exclusive solution database
Never be left without tech help again

Subscribe Now

Asked On: 2009-10-28 at 11:24:46ID24852106
Topics: CentOS
,; Linux
,; CPanel
Participating Experts: 5
Points: 500
Comments: 17

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

"The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
"Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
"Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Free Tech Articles

WARNING: 5 Reasons why you should NEVER fix a computer for free.
It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
SCCM OSD Basic troubleshooting
SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
Create a Win7 Gadget
This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
Outlook continually prompting for username and password
There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
Backup Exchange 2010 Information Store using Windows Backup
There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

Avoiding Bugs in Microsoft Access
Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
Top 10 Best New Features in Visio 2010
Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
IT Consultant Business Secrets Revealed
Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
Disaster Recovery and Business Continuity
Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
Organize Your Visio Diagrams with Containers and Lists
Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
How to Us Objects, Properties, Events and Methods in Microsoft Access
Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Watch More

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

by: legolasthehansyPosted on 2009-10-28 at 11:36:08ID: 25686676

Hi,

Please give the output of uptime, cat /proc/meminfo

Uptime will give the load average of the system.
/proc/meminfo give additional mem stats.

by: Andy1988Posted on 2009-10-28 at 11:39:05ID: 25686714

Here're the outputs:

uptime
 
 
14:37:52 up  1:09,  1 user,  load average: 12.99, 15.69, 22.27
 
 
/proc/meminfo
 
 
MemTotal:        2041760 kB
MemFree:          575252 kB
Buffers:          151928 kB
Cached:           907716 kB
SwapCached:            0 kB
Active:           674840 kB
Inactive:         687192 kB
Active(anon):     302432 kB
Inactive(anon):        0 kB
Active(file):     372408 kB
Inactive(file):   687192 kB
Unevictable:           0 kB
Mlocked:               0 kB
HighTotal:       1169352 kB
HighFree:           1644 kB
LowTotal:         872408 kB
LowFree:          573608 kB
SwapTotal:       4192924 kB
SwapFree:        4192924 kB
Dirty:              7788 kB
Writeback:             4 kB
AnonPages:        302300 kB
Mapped:            25116 kB
Slab:              72532 kB
SReclaimable:      55984 kB
SUnreclaim:        16548 kB
PageTables:        16984 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:     5213804 kB
Committed_AS:    2924256 kB
VmallocTotal:     122880 kB
VmallocUsed:        4020 kB
VmallocChunk:      81372 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        4088 kB
DirectMap2M:      905216 kB

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:

Select all Open in new window

by: legolasthehansyPosted on 2009-10-28 at 11:52:04ID: 25686844

It looks like the load is coming down.. if you check the 1st value (12).

please also post the 1st 10 lines of top command. You missed to paste them in your question.

Thanks!

by: Andy1988Posted on 2009-10-28 at 11:54:15ID: 25686865

here's that

top - 14:53:45 up  1:25,  1 user,  load average: 33.36, 28.24, 25.80
Tasks: 288 total,   1 running, 275 sleeping,  11 stopped,   1 zombie
Cpu(s): 12.8%us,  7.3%sy,  0.0%ni, 75.9%id,  3.5%wa,  0.1%hi,  0.5%si,  0.0%st
Mem:   2041760k total,  1515400k used,   526360k free,   165856k buffers
Swap:  4192924k total,        0k used,  4192924k free,  1026404k cached
 
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
29210 mysql     20   0  114m  29m 4220 S  9.3  1.5   1:00.40 mysqld
 3608 root      20   0 32644  29m 2412 S  6.3  1.5   0:04.51 spamd
 4638 vincecan  20   0 37604  15m 6604 S  2.7  0.8   0:00.15 php
 4685 sharktr   20   0 36568  14m 6216 S  2.7  0.7   0:00.08 php
 3660 nobody    20   0 26880  11m 1652 S  0.7  0.6   0:00.04 httpd
 1304 vincecan  20   0  7548 1088  700 S  0.3  0.1   0:00.28 pure-ftpd
 1610 nobody    20   0 26884  11m 1664 S  0.3  0.6   0:00.10 httpd
 1665 nobody    20   0 26884  11m 1676 S  0.3  0.6   0:00.08 httpd
 1669 nobody    20   0 26884  11m 1664 S  0.3  0.6   0:00.09 httpd
 4016 nobody    20   0 26884  11m 1668 S  0.3  0.6   0:00.04 httpd
 4225 mailman   20   0 10212 5956 2428 S  0.3  0.3   0:01.30 python2.4
 4440 root      20   0  2324 1152  796 R  0.3  0.1   0:00.14 top
 4460 nobody    20   0 26748  11m 1612 S  0.3  0.6   0:00.02 httpd
30965 nobody    20   0 27012  11m 2180 S  0.3  0.6   0:00.12 httpd
    1 root      20   0  2064  620  536 S  0.0  0.0   0:00.98 init
    2 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 kthreadd
    3 root      RT  -5     0    0    0 S  0.0  0.0   0:00.09 migration/0
    4 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 ksoftirqd/0
    5 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/0
    6 root      RT  -5     0    0    0 S  0.0  0.0   0:00.08 migration/1
    7 root      15  -5     0    0    0 S  0.0  0.0   0:00.07 ksoftirqd/1
    8 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/1
    9 root      RT  -5     0    0    0 S  0.0  0.0   0:00.27 migration/2
   10 root      15  -5     0    0    0 S  0.0  0.0   0:00.02 ksoftirqd/2
   11 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/2
   12 root      RT  -5     0    0    0 S  0.0  0.0   0:00.21 migration/3
   13 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 ksoftirqd/3
   14 root      RT  -5     0    0    0 S  0.0  0.0   0:00.00 watchdog/3
   15 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 cpuset
   16 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 events/0
   17 root      15  -5     0    0    0 S  0.0  0.0   0:00.01 events/1
   18 root      15  -5     0    0    0 S  0.0  0.0   0:00.03 events/2
   19 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 events/3
   20 root      15  -5     0    0    0 S  0.0  0.0   0:00.12 work_on_cpu/0
   21 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/1
   22 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/2
   23 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 work_on_cpu/3
   24 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 khelper
   27 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 netns
  165 root      15  -5     0    0    0 S  0.0  0.0   0:00.13 kblockd/0
  166 root      15  -5     0    0    0 S  0.0  0.0   0:00.28 kblockd/1
  167 root      15  -5     0    0    0 S  0.0  0.0   0:00.69 kblockd/2
  168 root      15  -5     0    0    0 S  0.0  0.0   0:00.06 kblockd/3
  169 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kacpid
  170 root      15  -5     0    0    0 S  0.0  0.0   0:00.00 kacpi_notify

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:

Select all Open in new window

by: legolasthehansyPosted on 2009-10-28 at 12:00:53ID: 25686934

It looks like MySQL is the culprit here. I dont think you need to bother if the server is functioning fine with some blips here and there. If the server is slow, then you would need to dwell deeper on what is causing the mysql process to spike the load on the server.

by: Andy1988Posted on 2009-10-28 at 12:05:28ID: 25686971

How can I detect that which thing is making MySQL to cause high server load?

by: Andy1988Posted on 2009-10-28 at 12:31:35ID: 25687250

Any help? Its urgent.

by: d4011Posted on 2009-10-28 at 14:20:53ID: 25688458

Open a mysql console and give us the output of
> show processlist;
this command will list all current conections, and what they are doing. You will need the PROCESS privilege to list connections from other users.
Also please post the output of
> show status;

by: Andy1988Posted on 2009-10-28 at 14:47:21ID: 25688697

Okay I'm getting this error when I'm typing show processlist;

ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'show processlist' at line 2

And here's the output of show status;

mysql> show status;
+-----------------------------------+----------+
| Variable_name                     | Value    |
+-----------------------------------+----------+
| Aborted_clients                   | 0        |
| Aborted_connects                  | 147      |
| Binlog_cache_disk_use             | 0        |
| Binlog_cache_use                  | 0        |
| Bytes_received                    | 115      |
| Bytes_sent                        | 177      |
| Com_admin_commands                | 0        |
| Com_alter_db                      | 0        |
| Com_alter_table                   | 0        |
| Com_analyze                       | 0        |
| Com_backup_table                  | 0        |
| Com_begin                         | 0        |
| Com_call_procedure                | 0        |
| Com_change_db                     | 0        |
| Com_change_master                 | 0        |
| Com_check                         | 0        |
| Com_checksum                      | 0        |
| Com_commit                        | 0        |
| Com_create_db                     | 0        |
| Com_create_function               | 0        |
| Com_create_index                  | 0        |
| Com_create_table                  | 0        |
| Com_create_user                   | 0        |
| Com_dealloc_sql                   | 0        |
| Com_delete                        | 0        |
| Com_delete_multi                  | 0        |
| Com_do                            | 0        |
| Com_drop_db                       | 0        |
| Com_drop_function                 | 0        |
| Com_drop_index                    | 0        |
| Com_drop_table                    | 0        |
| Com_drop_user                     | 0        |
| Com_execute_sql                   | 0        |
| Com_flush                         | 0        |
| Com_grant                         | 0        |
| Com_ha_close                      | 0        |
| Com_ha_open                       | 0        |
| Com_ha_read                       | 0        |
| Com_help                          | 0        |
| Com_insert                        | 0        |
| Com_insert_select                 | 0        |
| Com_kill                          | 0        |
| Com_load                          | 0        |
| Com_load_master_data              | 0        |
| Com_load_master_table             | 0        |
| Com_lock_tables                   | 0        |
| Com_optimize                      | 0        |
| Com_preload_keys                  | 0        |
| Com_prepare_sql                   | 0        |
| Com_purge                         | 0        |
| Com_purge_before_date             | 0        |
| Com_rename_table                  | 0        |
| Com_repair                        | 0        |
| Com_replace                       | 0        |
| Com_replace_select                | 0        |
| Com_reset                         | 0        |
| Com_restore_table                 | 0        |
| Com_revoke                        | 0        |
| Com_revoke_all                    | 0        |
| Com_rollback                      | 0        |
| Com_savepoint                     | 0        |
| Com_select                        | 1        |
| Com_set_option                    | 0        |
| Com_show_binlog_events            | 0        |
| Com_show_binlogs                  | 0        |
| Com_show_charsets                 | 0        |
| Com_show_collations               | 0        |
| Com_show_column_types             | 0        |
| Com_show_create_db                | 0        |
| Com_show_create_table             | 0        |
| Com_show_databases                | 0        |
| Com_show_errors                   | 0        |
| Com_show_fields                   | 0        |
| Com_show_grants                   | 0        |
| Com_show_innodb_status            | 0        |
| Com_show_keys                     | 0        |
| Com_show_logs                     | 0        |
| Com_show_master_status            | 0        |
| Com_show_ndb_status               | 0        |
| Com_show_new_master               | 0        |
| Com_show_open_tables              | 0        |
| Com_show_privileges               | 0        |
| Com_show_processlist              | 0        |
| Com_show_slave_hosts              | 0        |
| Com_show_slave_status             | 0        |
| Com_show_status                   | 1        |
| Com_show_storage_engines          | 0        |
| Com_show_tables                   | 0        |
| Com_show_triggers                 | 0        |
| Com_show_variables                | 0        |
| Com_show_warnings                 | 0        |
| Com_slave_start                   | 0        |
| Com_slave_stop                    | 0        |
| Com_stmt_close                    | 0        |
| Com_stmt_execute                  | 0        |
| Com_stmt_fetch                    | 0        |
| Com_stmt_prepare                  | 0        |
| Com_stmt_reset                    | 0        |
| Com_stmt_send_long_data           | 0        |
| Com_truncate                      | 0        |
| Com_unlock_tables                 | 0        |
| Com_update                        | 0        |
| Com_update_multi                  | 0        |
| Com_xa_commit                     | 0        |
| Com_xa_end                        | 0        |
| Com_xa_prepare                    | 0        |
| Com_xa_recover                    | 0        |
| Com_xa_rollback                   | 0        |
| Com_xa_start                      | 0        |
| Compression                       | OFF      |
| Connections                       | 16874    |
| Created_tmp_disk_tables           | 0        |
| Created_tmp_files                 | 91       |
| Created_tmp_tables                | 1        |
| Delayed_errors                    | 0        |
| Delayed_insert_threads            | 0        |
| Delayed_writes                    | 0        |
| Flush_commands                    | 1        |
| Handler_commit                    | 0        |
| Handler_delete                    | 0        |
| Handler_discover                  | 0        |
| Handler_prepare                   | 0        |
| Handler_read_first                | 0        |
| Handler_read_key                  | 0        |
| Handler_read_next                 | 0        |
| Handler_read_prev                 | 0        |
| Handler_read_rnd                  | 0        |
| Handler_read_rnd_next             | 0        |
| Handler_rollback                  | 0        |
| Handler_savepoint                 | 0        |
| Handler_savepoint_rollback        | 0        |
| Handler_update                    | 0        |
| Handler_write                     | 132      |
| Innodb_buffer_pool_pages_data     | 504      |
| Innodb_buffer_pool_pages_dirty    | 0        |
| Innodb_buffer_pool_pages_flushed  | 1299     |
| Innodb_buffer_pool_pages_free     | 0        |
| Innodb_buffer_pool_pages_misc     | 8        |
| Innodb_buffer_pool_pages_total    | 512      |
| Innodb_buffer_pool_read_ahead_rnd | 113      |
| Innodb_buffer_pool_read_ahead_seq | 35       |
| Innodb_buffer_pool_read_requests  | 1481839  |
| Innodb_buffer_pool_reads          | 1688     |
| Innodb_buffer_pool_wait_free      | 0        |
| Innodb_buffer_pool_write_requests | 12119    |
| Innodb_data_fsyncs                | 1285     |
| Innodb_data_pending_fsyncs        | 0        |
| Innodb_data_pending_reads         | 0        |
| Innodb_data_pending_writes        | 0        |
| Innodb_data_read                  | 47943680 |
| Innodb_data_reads                 | 2175     |
| Innodb_data_writes                | 2264     |
| Innodb_data_written               | 43496960 |
| Innodb_dblwr_pages_written        | 1299     |
| Innodb_dblwr_writes               | 185      |
| Innodb_log_waits                  | 0        |
| Innodb_log_write_requests         | 913      |
| Innodb_log_writes                 | 793      |
| Innodb_os_log_fsyncs              | 922      |
| Innodb_os_log_pending_fsyncs      | 0        |
| Innodb_os_log_pending_writes      | 0        |
| Innodb_os_log_written             | 868352   |
| Innodb_page_size                  | 16384    |
| Innodb_pages_created              | 9        |
| Innodb_pages_read                 | 2665     |
| Innodb_pages_written              | 1299     |
| Innodb_row_lock_current_waits     | 0        |
| Innodb_row_lock_time              | 157      |
| Innodb_row_lock_time_avg          | 26       |
| Innodb_row_lock_time_max          | 152      |
| Innodb_row_lock_waits             | 6        |
| Innodb_rows_deleted               | 76       |
| Innodb_rows_inserted              | 108      |
| Innodb_rows_read                  | 448467   |
| Innodb_rows_updated               | 2052     |
| Key_blocks_not_flushed            | 0        |
| Key_blocks_unused                 | 7008     |
| Key_blocks_used                   | 688      |
| Key_read_requests                 | 2530303  |
| Key_reads                         | 89670    |
| Key_write_requests                | 54542    |
| Key_writes                        | 20648    |
| Last_query_cost                   | 0.000000 |
| Max_used_connections              | 83       |
| Ndb_cluster_node_id               | 0        |
| Ndb_config_from_host              |          |
| Ndb_config_from_port              | 0        |
| Ndb_number_of_data_nodes          | 0        |
| Not_flushed_delayed_rows          | 0        |
| Open_files                        | 127      |
| Open_streams                      | 0        |
| Open_tables                       | 64       |
| Opened_tables                     | 0        |
| Prepared_stmt_count               | 0        |
| Qcache_free_blocks                | 0        |
| Qcache_free_memory                | 0        |
| Qcache_hits                       | 0        |
| Qcache_inserts                    | 0        |
| Qcache_lowmem_prunes              | 0        |
| Qcache_not_cached                 | 0        |
| Qcache_queries_in_cache           | 0        |
| Qcache_total_blocks               | 0        |
| Queries                           | 256969   |
| Questions                         | 2        |
| Rpl_status                        | NULL     |
| Select_full_join                  | 0        |
| Select_full_range_join            | 0        |
| Select_range                      | 0        |
| Select_range_check                | 0        |
| Select_scan                       | 1        |
| Slave_open_temp_tables            | 0        |
| Slave_retried_transactions        | 0        |
| Slave_running                     | OFF      |
| Slow_launch_threads               | 0        |
| Slow_queries                      | 0        |
| Sort_merge_passes                 | 0        |
| Sort_range                        | 0        |
| Sort_rows                         | 0        |
| Sort_scan                         | 0        |
| Table_locks_immediate             | 226990   |
| Table_locks_waited                | 401      |
| Tc_log_max_pages_used             | 0        |
| Tc_log_page_size                  | 0        |
| Tc_log_page_waits                 | 0        |
| Threads_cached                    | 0        |
| Threads_connected                 | 3        |
| Threads_created                   | 16873    |
| Threads_running                   | 1        |
| Uptime                            | 6699     |
| Uptime_since_flush_status         | 256969   |
+-----------------------------------+----------+
230 rows in set (0.00 sec)

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:
53:
54:
55:
56:
57:
58:
59:
60:
61:
62:
63:
64:
65:
66:
67:
68:
69:
70:
71:
72:
73:
74:
75:
76:
77:
78:
79:
80:
81:
82:
83:
84:
85:
86:
87:
88:
89:
90:
91:
92:
93:
94:
95:
96:
97:
98:
99:
100:
101:
102:
103:
104:
105:
106:
107:
108:
109:
110:
111:
112:
113:
114:
115:
116:
117:
118:
119:
120:
121:
122:
123:
124:
125:
126:
127:
128:
129:
130:
131:
132:
133:
134:
135:
136:
137:
138:
139:
140:
141:
142:
143:
144:
145:
146:
147:
148:
149:
150:
151:
152:
153:
154:
155:
156:
157:
158:
159:
160:
161:
162:
163:
164:
165:
166:
167:
168:
169:
170:
171:
172:
173:
174:
175:
176:
177:
178:
179:
180:
181:
182:
183:
184:
185:
186:
187:
188:
189:
190:
191:
192:
193:
194:
195:
196:
197:
198:
199:
200:
201:
202:
203:
204:
205:
206:
207:
208:
209:
210:
211:
212:
213:
214:
215:
216:
217:
218:
219:
220:
221:
222:
223:
224:
225:
226:
227:
228:
229:
230:
231:
232:
233:
234:
235:
236:

Select all Open in new window

by: d4011Posted on 2009-10-28 at 15:25:00ID: 25688941

What a mysql version do you use?
To be honest, i can't see the reason for the high load in these stats. I don't think that mysql is causing the problem. (To be honst, I'm not _the_ mysql expert).
Sorry for that.

by: fosiul01Posted on 2009-10-28 at 15:55:15ID: 25689132

Ok Few things

how do you know your server is high load ??
do you keep track of your server load regularly ???

if you do then can you tel me , whats made you think that your server is high l load??

From your top command

29210 mysql 20 0 114m 29m 4220 S 9.3 1.5 1:00.40 mysqld
3608 root 20 0 32644 29m 2412 S 6.3 1.5 0:04.51 spamd

what was the load for mysqld an spamd before ???

to me its like spamd is using quite lots cpu power

b) 3.5%wa : I/O waitting is slightly high

can you run vmstat for couple of minutes check whats the status of

vmstat 2 30

its will run 30 times.
but run for longer and look for
r b cs us sy id wa st

let me know which one is high or update some sample data here

be quick or i will see this tomorrow , if still you dont get solution

by: fosiul01Posted on 2009-10-28 at 16:01:26ID: 25689176

also run

iostat -d -x 5 3

show some sample data, but also read from google about what iostat parameter do

http://www.cyberciti.biz/tips/linux-disk-performance-monitoring-howto.html

by: Andy1988Posted on 2009-10-28 at 22:37:09ID: 25690926

Here's the output of iostat -d -x 5 3

root@server1 [~]# iostat -d -x 5 3
Linux 2.6.29.5-grsec-hostnoc-4.2.0-i386-libata (server1.SUPERSERVER1.INFO)     1                                                                                                 0/29/2009
 
Device:         rrqm/s   wrqm/s   r/s   w/s   rsec/s   wsec/s avgrq-sz avgqu-sz                                                                                                    await  svctm  %util
sda               0.15     0.00  0.01  0.00     0.19     0.00    34.21     0.00                                                                                                     4.56   3.69   0.00
sda1              0.14     0.00  0.00  0.00     0.16     0.00    37.09     0.00                                                                                                     5.00   3.88   0.00
sdb               0.32    37.58  1.22  0.36   358.49   303.50   419.05     0.09                                                                                                    56.93   6.73   1.06
sdb1              0.32    37.58  1.22  0.36   358.46   303.50   419.35     0.09                                                                                                    56.98   6.74   1.06
sdc               5.08    62.05  7.66 35.35   461.81   777.33    28.82    80.00                                                                                                  1859.59  17.98  77.32
sdc1              0.03     0.00  0.00  0.00     0.08     0.00    28.92     0.00                                                                                                    45.42  45.31   0.01
sdc2              1.07     9.44  1.65  5.87   128.58   121.58    33.26    20.53                                                                                                  2728.87  89.94  67.65
sdc3              2.81    19.62  2.47 23.79    67.42   347.23    15.79    39.85                                                                                                  1516.13  28.73  75.45
sdc4              0.00     0.00  0.00  0.00     0.00     0.00     2.00     0.00                                                                                                    66.00  66.00   0.00
sdc5              0.05     0.07  0.00  0.00     0.09     0.54   193.75     0.01                                                                                                  2537.63 1649.30   0.54
sdc6              0.11     3.47  0.30  0.55    13.55    32.15    53.73     1.43                                                                                                  1682.88 706.82  60.13
sdc7              0.05     7.85  0.37  2.06     3.47    79.27    34.00     7.02                                                                                                  2883.81 246.72  60.04
sdc8              0.95    21.62  2.86  3.07   248.60   196.56    75.13    11.17                                                                                                  1883.92 118.64  70.30
 
Device:         rrqm/s   wrqm/s   r/s   w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sda1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdb               0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdb1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc               0.00   178.60  2.80 137.40    28.80  2564.80    18.50    68.34  687.13   6.18  86.60
sdc1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc2              0.00    33.40  0.20 18.60     1.60   420.80    22.47    15.79  890.85  43.62  82.00
sdc3              0.00    63.60  1.80 107.80    17.60  1395.20    12.89    42.43  620.89   7.90  86.60
sdc4              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc5              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc6              0.00    15.80  0.20  1.20     3.20   136.00    99.43     0.24  174.29 174.29  24.40
sdc7              0.00    20.40  0.00  5.20     0.00   204.80    39.38     5.63 1265.77  78.46  40.80
sdc8              0.00    45.40  0.60  4.60     6.40   408.00    79.69     4.25  906.15 143.46  74.60
 
Device:         rrqm/s   wrqm/s   r/s   w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sda1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdb               0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdb1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc               0.00    66.80  1.20 48.80     9.60   910.40    18.40    12.74   29.44   6.04  30.20
sdc1              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc2              0.00     1.60  0.00  0.00     0.00     0.00     0.00     8.16    0.00   0.00  24.00
sdc3              0.00    33.20  0.80 44.00     6.40   616.00    13.89     3.96   32.50   6.38  28.60
sdc4              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc5              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
sdc6              0.00     0.00  0.00  0.00     0.00     0.00     0.00     0.22    0.00   0.00  22.40
sdc7              0.00     8.20  0.00  2.80     0.00    88.00    31.43     0.00    0.00   0.00   0.00
sdc8              0.00    23.80  0.40  2.00     3.20   206.40    87.33     0.39    6.67 100.00  24.00

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:

Select all Open in new window

by: Andy1988Posted on 2009-10-28 at 22:54:19ID: 25690981

Here's the vmstat output:

procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu-----                                                                                                 -
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
38  5   9400 651064 143556 899116    0    0    98   132  138  158 10  5 28 57  0
 0  7   9400 584428 143612 899160    0    0     8  1448  972 1616 40 20  8 32  0
 0  4   9400 470472 143624 899192    0    0    22   952  884  707 22 15 31 33  0
 4  6   9400 567356 143652 899252    0    0    48   954  801  803 12  8 44 36  0
19 10   9400 548452 143696 899552    0    0   252   332  828 1141 26 15 14 46  0
 8  2   9400 614480 143712 899904    0    0    52   606 1138 1432 32 20 29 19  0
 0  7   9400 638928 143756 900364    0    0   266  1280  873  864 17 11  9 64  0
 5  2   9400 622376 144108 900612    0    0    74  1168  971 1583 34 22 17 26  0
 4  5   9400 632100 144120 900680    0    0    22  1214 1064 1676 48 28 15  9  0
 3  3   9400 644740 144144 900756    0    0    22   528  973 1638 28 18 37 17  0
 2  4   9400 638284 144144 900780    0    0     0   230  936 1639 31 17 27 25  0
 0  9   9400 647820 144148 900796    0    0     0   102  848  893 12  7 40 41  0
 0  9   9400 645616 144148 900800    0    0     0     0  471  171  0  1 25 75  0
 0  9   9400 641288 144148 900800    0    0     0    38  479  221  0  1 25 74  0
 0  9   9400 638908 144148 900800    0    0     0    62  432  153  0  0 25 75  0
 0  9   9400 633688 144148 900800    0    0     0     0  464  207  1  0 24 75  0
 0  9   9400 632648 144148 900800    0    0     0     0  423  163  0  1 20 80  0
 0  5   9400 641848 144164 900784    0    0     2   582  509  191  0  0  3 96  0
 0 12   9400 482832 144212 900800    0    0     0  1602  746  623 29 20 12 39  0
 0  2   9400 482716 144240 900932    0    0    56   672  874 1655 50 20  9 21  0
 0  4   9400 620720 144264 901096    0    0    76  1354 1027 1356 23 12 35 30  0
procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu-----                                                                                                 -
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
19  1   9400 616356 144280 901172    0    0     4   564 1123 2218 56 34  8  2  0
 3  0   9400 666420 144576 901188    0    0     8  1556 1268 1905 30 17 40 13  0
 2  0   9400 678868 144608 901232    0    0     4  1168 1052 1541 26 17 47  9  0
 3  0   9400 672692 144608 901276    0    0    10   384 1055 1523 26 19 55  0  0
 0  5   9400 674792 144620 901316    0    0     2   994  989 1492 17 11 52 21  0
 0  6   9400 669188 144620 901320    0    0     0    44  582  203  0  1 50 49  0
 0  6   9400 668568 144620 901320    0    0     0     0  362  124  0  0 48 51  0
 0  6   9400 661804 144620 901320    0    0     0     0  448  186  0  1 17 82  0
 0  6   9400 667508 144620 901320    0    0     0     0  403  157  0  1  0 99  0

1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:

Select all Open in new window

by: fosiul01Posted on 2009-10-29 at 01:35:11ID: 25691548

Good morning

How old is this server ???
if you look at your vmstat report

"Wa" is too high also r b

in some sample r is 38,19 , 5 , 4 ,99

so there is a I/O bottol neck aswell in your server

how many processor you got ??

r : should not be higher then your process amount

if you lookat your

iostat -d -x 5 3

%util Some of them has value of 74 ,82
which indicates your hardrive performance is not that good

by: julianmatzPosted on 2009-11-04 at 14:46:01ID: 25744901

Hi Andy1988,

How many users or virtual hosts do you have on this server? How many of those users have stats activated? I mean Webalizer, AWStats, Analog ...

Try disabling stats for all accounts unless it's absolutely necessary to have them on. Or disable stats by default and let users choose if they want to activate them.

From experience, it's very often the stats software that causes high loads and sometimes also manages to crash a server.

Also, do you have a lot of Wordpress sites on your server?

by: modservPosted on 2009-11-14 at 01:23:10ID: 25819917

Hi,

Could you please paste the server information data ? Also you could make an optimization to Apache and MySQL to make sure that the load is not from them.

Thanks,

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

For individual users
Instant access to solutions
Ask your tech questions
Start your 30-day Free Trial

Business Accounts

Perfect for organizations
Multiple users
Save over 36%
Create a Business Account

Answer for Membership

Earn free access
Showcase your knowledge
No credit card required
Sign Up to Answer

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...

Question

High Server Load

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

CentOS

Linux

CPanel

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Need individual assistance?

Our experts are ready to help.

Want to learn from the best?

Read articles from industry experts.

Working on a long term project?

Store your work and research.

What Makes Experts Exchange Unique?

Trusted by the world's most respected brands.

Faithfully serving IT professionals since 1996.

Related Solutions

Free Tech Articles

Cloud Class Webinars

Join the Community

Give a Little. Get a Lot.

Answers

3 Ways to Join

The Experts

The Experts

Testimonials

Testimonials

Testimonials

Business Clients

Business Clients

In the Press

In the Press

In the Press