Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium

x
?
Solved

set priority of mysqlDaemon

Posted on 2010-08-19
6
Medium Priority
?
423 Views
Last Modified: 2012-05-10
hi Experts,
Can anyone tell me how to increase the assigned priority to mysqld.exe in a windows system.
I am trying to import and work with a huge huge data set . Each row has only about 5 or 20 columns. The number of rows is huge in millions. The mysqld is using only 25% of CPU on a windows XP machine and returns results after an hour. I am not using a server just  a normal desktop or laptop. I seem to able to increase the priority of mysql.exe but that of mysqld.exe because it is owned by the system? I would like to set it at real time and get back results much faster
thanks for the help
0
Comment
Question by:guyneo
  • 3
  • 3
6 Comments
 
LVL 81

Expert Comment

by:arnold
ID: 33482110
The issue is likely less to do with the priority/affinity of the process but with the data.
run explain <your query> in either the mysql query browser or using the mysql.exe command line tool.
It should tell you why your query takes this long.
I.e. you may need to add indexes/etc. to optimize the performance of the query
0
 
LVL 1

Author Comment

by:guyneo
ID: 33484594
This is one time task we are doing for extracting a subset of the data. How long would adding indexes would take on such huge data table?
0
 
LVL 81

Accepted Solution

by:
arnold earned 2000 total points
ID: 33485039
Are there existing indexes?  First you need to make sure you have enough space.
Presumably the data will remain and have entries added to it, so it is possible that a similar or other queries will be run against this data.
Was this data set part of a production database that was exported?
Your options are clear and in either case you would need to wait somewhat.
With the query, if you get unexpected results you have to adjust the query and wait just as long, with the addition of the indexes,  you may need to only wait once for the index processing to complete. and then if your initial query does not provide the data that you expect, the next queries might be faster.

There is no way to predict which is more beneficial to you or which less time consuming.
0
[Webinar On Demand] Database Backup and Recovery

Does your company store data on premises, off site, in the cloud, or a combination of these? If you answered “yes”, you need a data backup recovery plan that fits each and every platform. Watch now as as Percona teaches us how to build agile data backup recovery plan.

 
LVL 1

Author Comment

by:guyneo
ID: 33495306
I agree indexes would help. I was curious to see if I can get away without index in the first pass. That I am trying trim the useless data out  which might be up to 60-70%. So I thought why create index delete data and recreate data. But lesson learned :) indexes are always faster even though you would need for run a query for only one time  on a huge data set.
Anyway I am still interested to find out if we can increase the mysqld usage of the CPU. I experimented it on various machines, increase the innoDB buffer but it seems to use only upto 35% of the CPU.  Understandle and desirable when everything is one server but when we need to force it to use more, we should be able to. Otherwise thats seems like a waste of time and resources
0
 
LVL 81

Expert Comment

by:arnold
ID: 33506330
Allocating processor priority to real time may not improve or speed up the performance of your query/mysql, it may however, distabilize the system to a point of being unusable.
0
 
LVL 1

Author Comment

by:guyneo
ID: 33517298
Thanks arnold. I realized I should have done indexs right away.
Definitely learnt a couple of new things like explain in  this thread.
I am going to close this question even thoughwe didnot get the answer, I don't think that it is relevant any more.

 
0

Featured Post

Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Does the idea of dealing with bits scare or confuse you? Does it seem like a waste of time in an age where we all have terabytes of storage? If so, you're missing out on one of the core tools in every professional programmer's toolbox. Learn how to …
Load balancing is the method of dividing the total amount of work performed by one computer between two or more computers. Its aim is to get more work done in the same amount of time, ensuring that all the users get served faster.
In this video, Percona Solution Engineer Rick Golba discuss how (and why) you implement high availability in a database environment. To discuss how Percona Consulting can help with your design and architecture needs for your database and infrastr…
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB. To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses
Course of the Month12 days, 11 hours left to enroll

580 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question