Solved

Returning Large dataset from Oracle to SAS

Posted on 2013-06-21
5
613 Views
Last Modified: 2013-06-27
We have a query which runs on a SAS server and connects to an Oracle database.  The query is using sql-pass through and returns 20M rows.  Query ran for 10 hours and never returned anything.
proc sql;
  create temptbl as
  select * from sales where taxable = 'Y';
If we limit the rows, ie inobs=1000000, then we get a return dataset in 15 min.

Same query connecting to the same database but run on another, identical server returns dataset in 3 minutes.  Note:  we need all 20M rows.

We have validated server configuration, network traffic, nic card setting, database utilization are all the same between the two servers.  Two servers are on the same backbone and mounted on the same rack.  Evaluated each component in the stack (session, transport, network, etc) and have narrowed it down to the data after returning to the SAS server.

Any suggestions where to look?
0
Comment
Question by:slim7
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 29

Accepted Solution

by:
MikeOM_DBA earned 150 total points
ID: 39268790
There must still be a difference between the two servers which you have not detected.

1) Do you run the query on the other server also through "SAS"?
2) Do you create a file on the second server (the 3 min) or just return the data?

The bottleneck(s) I experienced in my SAS (dinosaur) days were: a) the creation of local files, 2) sort operations.

But with the minimal information you provided, this may be just speculation.
:p
0
 

Author Comment

by:slim7
ID: 39268949
We have run the query thru SAS and subsequently using ora sqlplus on the server.  sqlplus also returned the data very slow.  

To answer #2, we run the identical create table query on both servers.
Thanks
0
 
LVL 5

Assisted Solution

by:truinx
truinx earned 150 total points
ID: 39271911
Enable tracing and see the statistics behind the creation?
0
 
LVL 29

Expert Comment

by:MikeOM_DBA
ID: 39272080
Also, check out that OPTIMIZER_MODE is set to FIRST ROWS
0
 

Author Comment

by:slim7
ID: 39282271
Thanks all.  We had ruled out oracle from the equation and focused on the NIC setting.  Issue resolved, there is a bug in the ethernet driver. https://access.redhat.com/site/solutions/20278
0

Featured Post

Visualize your virtual and backup environments

Create well-organized and polished visualizations of your virtual and backup environments when planning VMware vSphere, Microsoft Hyper-V or Veeam deployments. It helps you to gain better visibility and valuable business insights.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Note: this article covers simple compression. Oracle introduced in version 11g release 2 a new feature called Advanced Compression which is not covered here. General principle of Oracle compression Oracle compression is a way of reducing the d…
ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
This video explains at a high level with the mandatory Oracle Memory processes are as well as touching on some of the more common optional ones.
This video explains at a high level about the four available data types in Oracle and how dates can be manipulated by the user to get data into and out of the database.

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question