SQL Server Performance

Hi,

I'm building a Datawarehouse project with SSIS and SSAS.
I've issue with my packages nd query running really slow as I'm quering 2.5 billions of rows with clustered index on the table.

I've attached performance monitor screenshot at the time of my CUBE is processing data.

Can anyone tell me the issue on the server perfromance by looking at Performance monitor.
I dont have much experience on SQL performanc monitoring and measering.

Thanks in advance
keplanAsked:
Who is Participating?
 
Eugene ZConnect With a Mentor Commented:
procs  are faster  than AD-hoc version of the same code ...

are you using some "where"  criteria in you query? if 'yes' - do you have index for this?
how many columns are included? do you need all?

it is no easy to optimize without seeing table structure and query it self ...

you many need to load the data in smaller batches maybe using "weekly partitions"


--

you need to review indexing

check the post for ideas:

stackoverflow.com/questions/337744/whats-your-approach-for-optimizing-large-tables-1m-rows-on-sql-server


Planning Guidelines for Partitioned Tables and Indexes
http://msdn.microsoft.com/en-us/library/ms180767(v=sql.105).aspx
0
 
jjjosefCommented:
You should check the performance of the SQL server and try to improve your server performance :-

Check theCPU usage while running SQL SERVER
Check memory usage by particular query is running
Defragment you database
If in SQL server any object or file  is taking large space switch it into a new filegroup

Partitioning of the table &  the database if require

These operations  would be helpful in order to improve your SQL Server Performance
Also refer the following article for SQL server performance issue :-

Five Things That Fix Bad SQL Server Performance

~ Edit by Modulus_Twelve - This post contains unattributed content from http://www.sqlteam.com/forums/topic.asp?TOPIC_ID=181985 ~
0
 
Aaron ShiloChief Database ArchitectCommented:
hi

maybe its just me but i don't see any attachments.
0
Cloud Class® Course: Certified Penetration Testing

This CPTE Certified Penetration Testing Engineer course covers everything you need to know about becoming a Certified Penetration Testing Engineer. Career Path: Professional roles include Ethical Hackers, Security Consultants, System Administrators, and Chief Security Officers.

 
jjjosefCommented:
I think keplan forget to upload the attachment I don't find too !
0
 
keplanAuthor Commented:
0
 
keplanAuthor Commented:
I've attached a screenshot of the PerfMonitor at the time  the system is slow.
Please give us your input.
0
 
Eugene ZCommented:
keplan,
as per the  attached picture - your server is chocking
----------------------------------------------------------------------------------------

< query running really slow as I'm quering 2.5 billions of rows with clustered index on the table.
>
please clarify  "really slow"
did it run fast before?


----
are you using "pump" from table or using t-sql in your SSIS?
if query: is it AD-HOC or stor proc (it would be better vs. Ad-Hoc )

 how fast does it run without SSIS?

you probably need to optimize this t-sql (add indexes; run DB maints: such as update start;reindex)


also you may need to add more memory \CPU to Sql server and SSAS box(s)

BTW: sql server and SSAS on the same box or different servers? if "different" - are they in the same DC or remote?

----------
0
 
keplanAuthor Commented:
Hi EugeneZ

I'm reading a single table with 2.3 billions record, I've one clustered index on the table.
Does it best practice to add more index to this table? The Cluster index is a composite key.

and also Table has been partition into weeks

It has not run faster, my requirment to run this faster

I used TSQL script not a Stored proc. Does it make any difference to ths process.



All the component, SSAS and SSIS and SQL server running on the same server.
But, I'm deploying to another SSAS server.

Yes, it is same AD.

Please give me some addtional help, thank you.
Could you please let me know how to optimize the query or DB or Table? I nevere done this, so keen to learn.
0
 
keplanAuthor Commented:
I've requested that this question be closed as follows:

Accepted answer: 167 points for EugeneZ's comment #a38878512
Assisted answer: 167 points for jjjosef's comment #a38858366
Assisted answer: 166 points for EugeneZ's comment #a38874594
Assisted answer: 0 points for keplan's comment #a38877984

for the following reason:

d
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.