Solved

set priority of mysqlDaemon

Posted on 2010-08-19
6
408 Views
Last Modified: 2012-05-10
hi Experts,
Can anyone tell me how to increase the assigned priority to mysqld.exe in a windows system.
I am trying to import and work with a huge huge data set . Each row has only about 5 or 20 columns. The number of rows is huge in millions. The mysqld is using only 25% of CPU on a windows XP machine and returns results after an hour. I am not using a server just  a normal desktop or laptop. I seem to able to increase the priority of mysql.exe but that of mysqld.exe because it is owned by the system? I would like to set it at real time and get back results much faster
thanks for the help
0
Comment
Question by:guyneo
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 3
6 Comments
 
LVL 79

Expert Comment

by:arnold
ID: 33482110
The issue is likely less to do with the priority/affinity of the process but with the data.
run explain <your query> in either the mysql query browser or using the mysql.exe command line tool.
It should tell you why your query takes this long.
I.e. you may need to add indexes/etc. to optimize the performance of the query
0
 
LVL 1

Author Comment

by:guyneo
ID: 33484594
This is one time task we are doing for extracting a subset of the data. How long would adding indexes would take on such huge data table?
0
 
LVL 79

Accepted Solution

by:
arnold earned 500 total points
ID: 33485039
Are there existing indexes?  First you need to make sure you have enough space.
Presumably the data will remain and have entries added to it, so it is possible that a similar or other queries will be run against this data.
Was this data set part of a production database that was exported?
Your options are clear and in either case you would need to wait somewhat.
With the query, if you get unexpected results you have to adjust the query and wait just as long, with the addition of the indexes,  you may need to only wait once for the index processing to complete. and then if your initial query does not provide the data that you expect, the next queries might be faster.

There is no way to predict which is more beneficial to you or which less time consuming.
0
Get 15 Days FREE Full-Featured Trial

Benefit from a mission critical IT monitoring with Monitis Premium or get it FREE for your entry level monitoring needs.
-Over 200,000 users
-More than 300,000 websites monitored
-Used in 197 countries
-Recommended by 98% of users

 
LVL 1

Author Comment

by:guyneo
ID: 33495306
I agree indexes would help. I was curious to see if I can get away without index in the first pass. That I am trying trim the useless data out  which might be up to 60-70%. So I thought why create index delete data and recreate data. But lesson learned :) indexes are always faster even though you would need for run a query for only one time  on a huge data set.
Anyway I am still interested to find out if we can increase the mysqld usage of the CPU. I experimented it on various machines, increase the innoDB buffer but it seems to use only upto 35% of the CPU.  Understandle and desirable when everything is one server but when we need to force it to use more, we should be able to. Otherwise thats seems like a waste of time and resources
0
 
LVL 79

Expert Comment

by:arnold
ID: 33506330
Allocating processor priority to real time may not improve or speed up the performance of your query/mysql, it may however, distabilize the system to a point of being unusable.
0
 
LVL 1

Author Comment

by:guyneo
ID: 33517298
Thanks arnold. I realized I should have done indexs right away.
Definitely learnt a couple of new things like explain in  this thread.
I am going to close this question even thoughwe didnot get the answer, I don't think that it is relevant any more.

 
0

Featured Post

On Demand Webinar: Networking for the Cloud Era

Did you know SD-WANs can improve network connectivity? Check out this webinar to learn how an SD-WAN simplified, one-click tool can help you migrate and manage data in the cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This post contains step-by-step instructions for setting up alerting in Percona Monitoring and Management (PMM) using Grafana.
This post looks at MongoDB and MySQL, and covers high-level MongoDB strengths, weaknesses, features, and uses from the perspective of an SQL user.
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…
Monitoring a network: how to monitor network services and why? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the philosophy behind service monitoring and why a handshake validation is critical in network monitoring. Software utilized …

617 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question