Solved

set priority of mysqlDaemon

Posted on 2010-08-19
6
385 Views
Last Modified: 2012-05-10
hi Experts,
Can anyone tell me how to increase the assigned priority to mysqld.exe in a windows system.
I am trying to import and work with a huge huge data set . Each row has only about 5 or 20 columns. The number of rows is huge in millions. The mysqld is using only 25% of CPU on a windows XP machine and returns results after an hour. I am not using a server just  a normal desktop or laptop. I seem to able to increase the priority of mysql.exe but that of mysqld.exe because it is owned by the system? I would like to set it at real time and get back results much faster
thanks for the help
0
Comment
Question by:guyneo
  • 3
  • 3
6 Comments
 
LVL 76

Expert Comment

by:arnold
Comment Utility
The issue is likely less to do with the priority/affinity of the process but with the data.
run explain <your query> in either the mysql query browser or using the mysql.exe command line tool.
It should tell you why your query takes this long.
I.e. you may need to add indexes/etc. to optimize the performance of the query
0
 
LVL 1

Author Comment

by:guyneo
Comment Utility
This is one time task we are doing for extracting a subset of the data. How long would adding indexes would take on such huge data table?
0
 
LVL 76

Accepted Solution

by:
arnold earned 500 total points
Comment Utility
Are there existing indexes?  First you need to make sure you have enough space.
Presumably the data will remain and have entries added to it, so it is possible that a similar or other queries will be run against this data.
Was this data set part of a production database that was exported?
Your options are clear and in either case you would need to wait somewhat.
With the query, if you get unexpected results you have to adjust the query and wait just as long, with the addition of the indexes,  you may need to only wait once for the index processing to complete. and then if your initial query does not provide the data that you expect, the next queries might be faster.

There is no way to predict which is more beneficial to you or which less time consuming.
0
What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

 
LVL 1

Author Comment

by:guyneo
Comment Utility
I agree indexes would help. I was curious to see if I can get away without index in the first pass. That I am trying trim the useless data out  which might be up to 60-70%. So I thought why create index delete data and recreate data. But lesson learned :) indexes are always faster even though you would need for run a query for only one time  on a huge data set.
Anyway I am still interested to find out if we can increase the mysqld usage of the CPU. I experimented it on various machines, increase the innoDB buffer but it seems to use only upto 35% of the CPU.  Understandle and desirable when everything is one server but when we need to force it to use more, we should be able to. Otherwise thats seems like a waste of time and resources
0
 
LVL 76

Expert Comment

by:arnold
Comment Utility
Allocating processor priority to real time may not improve or speed up the performance of your query/mysql, it may however, distabilize the system to a point of being unusable.
0
 
LVL 1

Author Comment

by:guyneo
Comment Utility
Thanks arnold. I realized I should have done indexs right away.
Definitely learnt a couple of new things like explain in  this thread.
I am going to close this question even thoughwe didnot get the answer, I don't think that it is relevant any more.

 
0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

As a database administrator, you may need to audit your table(s) to determine whether the data types are optimal for your real-world data needs.  This Article is intended to be a resource for such a task. Preface The other day, I was involved …
Does the idea of dealing with bits scare or confuse you? Does it seem like a waste of time in an age where we all have terabytes of storage? If so, you're missing out on one of the core tools in every professional programmer's toolbox. Learn how to …
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

7 Experts available now in Live!

Get 1:1 Help Now