Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

Returning Large dataset from Oracle to SAS

Posted on 2013-06-21
5
607 Views
Last Modified: 2013-06-27
We have a query which runs on a SAS server and connects to an Oracle database.  The query is using sql-pass through and returns 20M rows.  Query ran for 10 hours and never returned anything.
proc sql;
  create temptbl as
  select * from sales where taxable = 'Y';
If we limit the rows, ie inobs=1000000, then we get a return dataset in 15 min.

Same query connecting to the same database but run on another, identical server returns dataset in 3 minutes.  Note:  we need all 20M rows.

We have validated server configuration, network traffic, nic card setting, database utilization are all the same between the two servers.  Two servers are on the same backbone and mounted on the same rack.  Evaluated each component in the stack (session, transport, network, etc) and have narrowed it down to the data after returning to the SAS server.

Any suggestions where to look?
0
Comment
Question by:slim7
  • 2
  • 2
5 Comments
 
LVL 29

Accepted Solution

by:
MikeOM_DBA earned 150 total points
ID: 39268790
There must still be a difference between the two servers which you have not detected.

1) Do you run the query on the other server also through "SAS"?
2) Do you create a file on the second server (the 3 min) or just return the data?

The bottleneck(s) I experienced in my SAS (dinosaur) days were: a) the creation of local files, 2) sort operations.

But with the minimal information you provided, this may be just speculation.
:p
0
 

Author Comment

by:slim7
ID: 39268949
We have run the query thru SAS and subsequently using ora sqlplus on the server.  sqlplus also returned the data very slow.  

To answer #2, we run the identical create table query on both servers.
Thanks
0
 
LVL 5

Assisted Solution

by:truinx
truinx earned 150 total points
ID: 39271911
Enable tracing and see the statistics behind the creation?
0
 
LVL 29

Expert Comment

by:MikeOM_DBA
ID: 39272080
Also, check out that OPTIMIZER_MODE is set to FIRST ROWS
0
 

Author Comment

by:slim7
ID: 39282271
Thanks all.  We had ruled out oracle from the equation and focused on the NIC setting.  Issue resolved, there is a bug in the ethernet driver. https://access.redhat.com/site/solutions/20278
0

Featured Post

The Eight Noble Truths of Backup and Recovery

How can IT departments tackle the challenges of a Big Data world? This white paper provides a roadmap to success and helps companies ensure that all their data is safe and secure, no matter if it resides on-premise with physical or virtual machines or in the cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Working with Network Access Control Lists in Oracle 11g (part 2) Part 1: http://www.e-e.com/A_8429.html Previously, I introduced the basics of network ACL's including how to create, delete and modify entries to allow and deny access.  For many…
From implementing a password expiration date, to datatype conversions and file export options, these are some useful settings I've found in Jasper Server.
This video shows information on the Oracle Data Dictionary, starting with the Oracle documentation, explaining the different types of Data Dictionary views available by group and permissions as well as giving examples on how to retrieve data from th…
This video shows how to copy an entire tablespace from one database to another database using Transportable Tablespace functionality.

861 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question