Solved

Returning Large dataset from Oracle to SAS

Posted on 2013-06-21
5
604 Views
Last Modified: 2013-06-27
We have a query which runs on a SAS server and connects to an Oracle database.  The query is using sql-pass through and returns 20M rows.  Query ran for 10 hours and never returned anything.
proc sql;
  create temptbl as
  select * from sales where taxable = 'Y';
If we limit the rows, ie inobs=1000000, then we get a return dataset in 15 min.

Same query connecting to the same database but run on another, identical server returns dataset in 3 minutes.  Note:  we need all 20M rows.

We have validated server configuration, network traffic, nic card setting, database utilization are all the same between the two servers.  Two servers are on the same backbone and mounted on the same rack.  Evaluated each component in the stack (session, transport, network, etc) and have narrowed it down to the data after returning to the SAS server.

Any suggestions where to look?
0
Comment
Question by:slim7
  • 2
  • 2
5 Comments
 
LVL 29

Accepted Solution

by:
MikeOM_DBA earned 150 total points
ID: 39268790
There must still be a difference between the two servers which you have not detected.

1) Do you run the query on the other server also through "SAS"?
2) Do you create a file on the second server (the 3 min) or just return the data?

The bottleneck(s) I experienced in my SAS (dinosaur) days were: a) the creation of local files, 2) sort operations.

But with the minimal information you provided, this may be just speculation.
:p
0
 

Author Comment

by:slim7
ID: 39268949
We have run the query thru SAS and subsequently using ora sqlplus on the server.  sqlplus also returned the data very slow.  

To answer #2, we run the identical create table query on both servers.
Thanks
0
 
LVL 5

Assisted Solution

by:truinx
truinx earned 150 total points
ID: 39271911
Enable tracing and see the statistics behind the creation?
0
 
LVL 29

Expert Comment

by:MikeOM_DBA
ID: 39272080
Also, check out that OPTIMIZER_MODE is set to FIRST ROWS
0
 

Author Comment

by:slim7
ID: 39282271
Thanks all.  We had ruled out oracle from the equation and focused on the NIC setting.  Issue resolved, there is a bug in the ethernet driver. https://access.redhat.com/site/solutions/20278
0

Featured Post

Control application downtime with dependency maps

Visualize the interdependencies between application components better with Applications Manager's automated application discovery and dependency mapping feature. Resolve performance issues faster by quickly isolating problematic components.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Migrate database to ASM disks. 1 39
Oracle Syntax 8 55
Oracle - Create Procedure with Paramater 16 56
Oracle Public Synonyms and Privileges 2 50
This article started out as an Experts-Exchange question, which then grew into a quick tip to go along with an IOUG presentation for the Collaborate confernce and then later grew again into a full blown article with expanded functionality and legacy…
ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
This video shows how to copy a database user from one database to another user DBMS_METADATA.  It also shows how to copy a user's permissions and discusses password hash differences between Oracle 10g and 11g.
This video explains at a high level about the four available data types in Oracle and how dates can be manipulated by the user to get data into and out of the database.

919 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now