Solved

Returning Large dataset from Oracle to SAS

Posted on 2013-06-21
5
602 Views
Last Modified: 2013-06-27
We have a query which runs on a SAS server and connects to an Oracle database.  The query is using sql-pass through and returns 20M rows.  Query ran for 10 hours and never returned anything.
proc sql;
  create temptbl as
  select * from sales where taxable = 'Y';
If we limit the rows, ie inobs=1000000, then we get a return dataset in 15 min.

Same query connecting to the same database but run on another, identical server returns dataset in 3 minutes.  Note:  we need all 20M rows.

We have validated server configuration, network traffic, nic card setting, database utilization are all the same between the two servers.  Two servers are on the same backbone and mounted on the same rack.  Evaluated each component in the stack (session, transport, network, etc) and have narrowed it down to the data after returning to the SAS server.

Any suggestions where to look?
0
Comment
Question by:slim7
  • 2
  • 2
5 Comments
 
LVL 29

Accepted Solution

by:
MikeOM_DBA earned 150 total points
Comment Utility
There must still be a difference between the two servers which you have not detected.

1) Do you run the query on the other server also through "SAS"?
2) Do you create a file on the second server (the 3 min) or just return the data?

The bottleneck(s) I experienced in my SAS (dinosaur) days were: a) the creation of local files, 2) sort operations.

But with the minimal information you provided, this may be just speculation.
:p
0
 

Author Comment

by:slim7
Comment Utility
We have run the query thru SAS and subsequently using ora sqlplus on the server.  sqlplus also returned the data very slow.  

To answer #2, we run the identical create table query on both servers.
Thanks
0
 
LVL 5

Assisted Solution

by:truinx
truinx earned 150 total points
Comment Utility
Enable tracing and see the statistics behind the creation?
0
 
LVL 29

Expert Comment

by:MikeOM_DBA
Comment Utility
Also, check out that OPTIMIZER_MODE is set to FIRST ROWS
0
 

Author Comment

by:slim7
Comment Utility
Thanks all.  We had ruled out oracle from the equation and focused on the NIC setting.  Issue resolved, there is a bug in the ethernet driver. https://access.redhat.com/site/solutions/20278
0

Featured Post

Zoho SalesIQ

Hassle-free live chat software re-imagined for business growth. 2 users, always free.

Join & Write a Comment

From implementing a password expiration date, to datatype conversions and file export options, these are some useful settings I've found in Jasper Server.
Meet the world's only “Transparent Cloud™” from Superb Internet Corporation. Now, you can experience firsthand a cloud platform that consistently outperforms Amazon Web Services (AWS), IBM’s Softlayer, and Microsoft’s Azure when it comes to CPU and …
This video explains at a high level with the mandatory Oracle Memory processes are as well as touching on some of the more common optional ones.
This video explains at a high level about the four available data types in Oracle and how dates can be manipulated by the user to get data into and out of the database.

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

17 Experts available now in Live!

Get 1:1 Help Now