Advertisement

03.29.2008 at 05:41AM PDT, ID: 23279338
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

ASYNC_NETWORK_IO wait issue with DTS

Tags: Microsoft, SQL Server, 2005, DTS, SQL Wait Types
Hi,

I'm having a problem with DTS and wait types that seems to be baffling me at the moment.

I am using DTS on a SQL Server 2005 database (yes I know but thats the only option I have atm). Everytime I run the transform task to bulk insert the results of this query into another table the INSERT is blocked with the wait type of ASYNC_NETWORK_IO.

SELECT    bhp.P_URN,
          NULL AS OrgID,
          NULL AS LocID,
          ra.LocID As SuppliedLocID,
          t.BinTerritoryID,
          dbo.fn_dGetStandardDate(ra.DATE) AS ActivityDate,
          CASE CALL_TYPE
             WHEN 'Something' THEN 'MT'
             ELSE 'CA'
          END AS ActivityTypeID,
          NULL AS CustType,
          ra.ClientActivityID
FROM      nov_RAWActivity ra
             INNER JOIN
          History_Mirror.dbo.People bhp
             ON CAST(RIGHT(ra.URN, LEN(ra.URN) -1) AS int) = bhp.P_URN
             INNER JOIN
          Core.dbo.Territory t
             ON ra.TERRITORY = t.ClientTerritoryID
             LEFT OUTER JOIN
          Staging.dbo.xxx_Activity sa
             ON ra.ClientActivityID = sa.ClientActivityID
WHERE     ISNUMERIC(RIGHT(ra.URN, LEN(ra.URN) -1)) = 1
AND       t.CompanyID = 'xxx'
AND       sa.ClientActivityID IS NULL

As you can see from the query there are some hideous things i have to do to the data in joins because it is a data warehouse taking raw data from a client and formatting it into the format of the warehouse, but this, run as a simple SELECT on its own takes about 20 seconds to return 400,000 rows so the query should be fine (although not pretty).
Start your free trial to view this solution
Question Stats
Zone: Microsoft
Question Asked By: Binleys
Solution Provided By: tedbilly
Participating Experts: 2
Solution Grade: B
Views: 37
Translate:
Loading Advertisement...
03.29.2008 at 07:35PM PDT, ID: 21239305

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
03.31.2008 at 06:56PM PDT, ID: 21250683

Rank: Guru

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
04.28.2008 at 01:20AM PDT, ID: 21452284

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
04.28.2008 at 10:38AM PDT, ID: 21455917

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
04.29.2008 at 01:27AM PDT, ID: 21460432

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
Microsoft
  • Internet Protocols
  • Applications
  • Development
  • OS
  • Hardware
  • Windows Security
Apple
  • Operating Systems
  • Hardware
  • Programming
  • Networking
  • Software
Internet
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Spy / Ad Blockers
  • Web Browsers
  • New Net Users
  • Web Development
  • Chat / IM
  • Anti Spam
  • Web Servers
  • Anti-Virus
  • Email Clients
Gamers
  • Tips
  • Online / MMORPG
  • Puzzle
  • Emulators
  • Action / Adventure
  • Role Playing
  • Consoles
  • Game Programming
  • Strategy
  • Sports
  • Misc
  • Computer Games
Digital Living
  • Hardware
  • New Net Users
  • New Users
  • Software
  • Digital Music
  • Gaming World
  • Home Security
  • Apple
  • Networking Hardware
Virus & Spyware
  • Vulnerabilities
  • IDS
  • Encryption
  • Anti-Virus
  • Operating Systems Security
  • Software Firewalls
  • WebApplications
  • Cell Phones
  • Operating Systems
  • Internet
  • Hardware Firewalls
Hardware
  • Handhelds / PDAs
  • Displays / Monitors
  • Components
  • Networking Hardware
  • Peripherals
  • Laptops/Notebooks
  • Storage
  • Servers
  • Desktops
  • New Users
  • Misc
  • Apple
Software
  • System Utilities
  • Industry Specific
  • Network Management
  • Photos / Graphics
  • Page Layout
  • VMWare
  • Misc
  • Web Development
  • OS
  • CYGWIN
  • Voice Recognition
  • Message Queue
  • Quality Assurance
  • Security
  • Firewalls
  • MultiMedia Applications
  • Development
  • Database
  • Office / Productivity
  • Business Management
  • OS/2 Apps
  • Server Software
  • Internet / Email
ITPro
  • OS
  • Storage
  • Encryption
  • Operating Systems Security
  • Apple Hardware
  • Laptops & Notebooks
  • Servers
  • Networking Hardware
  • Peripherals
  • Devices
  • Displays / Monitors
  • WebTrends / Stats
  • Search Engines
  • Firewalls
  • WebApplications
  • IDS
  • Vulnerabilities
  • Email Clients
  • File Sharing
  • Spy / Ad Blockers
  • Web Browsers
  • Web Servers
  • Networking
  • Anti-Virus
  • Chat / IM
  • Anti Spam
Developer
  • Web Servers
  • Web Browsers
  • Game Programming
  • Dev Tools
  • Industry Specific
  • Office / Productivity
  • Database
  • CYGWIN
  • Web Development
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Programming
  • Content Management
  • Application Servers
  • Protocols
Storage
  • Removable Backup Media
  • Storage Technology
  • Servers
  • Grid
  • Remote Access
  • Backup / Restore
  • Misc
  • Hard Drives
OS
  • Miscellaneous
  • Security
  • Development
  • Linux
  • VMWare
  • MainFrame OS
  • Unix
  • Apple
  • OS / 2
  • AS / 400
  • BeOS
  • Microsoft
  • VMS / OpenVMS
Database
  • Oracle
  • Miscellaneous
  • MySQL
  • Software
  • Sybase
  • Contact Management
  • PostgreSQL
  • Data Manipulation
  • Clarion
  • InterSystems Cache
  • Siebel
  • MUMPS
  • OLAP
  • SQLBase
  • SAS
  • GIS & GPS
  • 4GL
  • Berkeley DB
  • DB2
  • Informix
  • Interbase / Firebird
  • FoxPro
  • Reporting
  • LDAP
  • Filemaker Pro
  • MS SQL Server
  • dBase
  • MS Access
Security
  • Misc
  • Web Browsers
  • Software Firewalls
  • Operating Systems Security
  • File Sharing
  • Spy / Ad Blockers
  • Vulnerabilities
  • WebApplications
  • IDS
  • Anti-Virus
  • Encryption
  • Anti Spam
  • Email Clients
  • VPN
  • Chat / IM
Programming
  • Editors IDEs
  • Installation
  • Handhelds / PDAs
  • Multimedia Programming
  • System / Kernel
  • Algorithms
  • Game
  • Signal Processing
  • Project Management
  • Open Source
  • Database
  • Misc
  • Languages
  • Processor Platforms
  • Theory
Web Development
  • Scripting
  • Blogs
  • Web Servers
  • Software
  • Search Engines
  • Web Graphics
  • Images
  • Internet Marketing
  • Images and Photos
  • Components
  • Document Imaging
  • Web Languages/Standards
  • Illustration
  • WebApplications
  • Fonts
  • WebTrends / Stats
  • Authoring
  • Digital Camera Software
  • Miscellaneous
Networking
  • Protocols
  • Apple Networking
  • Network Management
  • Message Queue
  • Application Servers
  • Content Management
  • File Servers
  • Email Servers
  • Misc
  • Java Editors & IDEs
  • Wireless
  • Networking Hardware
  • Backup / Restore
  • System Utilities
  • ISPs & Hosting
  • Web Servers
  • Storage Technology
  • Removable Backup Media
  • Servers
  • Broadband
  • Grid
  • OS / 2
  • Novell Netware
  • Unix Networking
  • Windows Networking
  • Security
  • Telecommunications
  • Operating Systems
  • Linux Networking
Other
  • Community Advisor
  • Lounge
  • Community Support
  • New Net Users
  • Philosophy / Religion
  • Math / Science
  • Miscellaneous
  • URLs
  • Expert Lounge
  • Politics
  • Puzzles / Riddles
Community Support
  • Suggestions
  • New to EE
  • New Topics
  • Community Advisor
  • CleanUp
  • Announcements
  • General
  • Feedback
  • Input
  • EE Bugs
 
03.29.2008 at 07:35PM PDT, ID: 21239305

Rank: Master

Well for one I see something odd about your query.  You are doing a LEFT OUTER JOIN of the Staging.dbo.xxx_Activity table using the ClientActivityID but in the predicate clause you state that the ClientActivityID in Staging.dbo.xxx_Activity has to be NULL.  So, you will NEVER get any matches on the LEFT OUTER JOIN which means you can exclude if from the query.

This article on improving DTS performance is excellent, however, this specific page on improving Data Pump performance is likely the most relevant in your case.
http://www.informit.com/articles/article.aspx?p=23571&seqNum=7
Accepted Solution
 
03.31.2008 at 06:56PM PDT, ID: 21250683

Rank: Guru

ASYNC_NETWORK_IO means that its waiting to push the data out through the network. There's some kind of bottleneck there.

What kind of network do you have between the source tables and destination table? Whats the link speed?

Is there any way that you can reduce the amount of data? i.e. remove padding, unneeded columns?

If you look at performance monitor (perfmon.exe) you should see a big spike in network I/O as it tries to push the data through.

You should also see a spike in the destination computers network I/O

This at least tells you that its using all the available network I/O
Assisted Solution
 
04.28.2008 at 01:20AM PDT, ID: 21452284
Thanks for your comments so far (especially the DTS performance thing, I didn;t know that and it has helped on a lot of our other dts packages). However the problem still remains. I have found that this seems to be more of an intermediate thing. I can run a DTS several times and then all of a sudden it will get stuck on a step with this wait again.
 
04.28.2008 at 10:38AM PDT, ID: 21455917

Rank: Master

Have you analyzed the query using SQL Query Analyzer?  As I mentioned, the LEFT OUTER JOIN doesn't appear to be correct.  If there are any inefficiencies in a query DTS will magnify the performance issues.
Assisted Solution
 
04.29.2008 at 01:27AM PDT, ID: 21460432
Yes I have and it appears to be ok (apart from having to do some custom transforming in the query itself).

The OUTER JOIN seems to be doing what I put it there to do which is simply ensuring the data selected from the raw table is not already in the staging table. Is there a more efficient way of doing this with DTS rather than using the OUTER JOIN?

I need to be able to load data this way because the raw data comes from Clients and is only propogated through the warehouse if it resolves to our own data. As our database is constantly validated and updated, unresolved raw data loaded in previous runs may be resolved by a newer entry in our database during a later run. This can then be loaded though the warehouse.
 
 
20080236-EE-VQP-29 / EE_QW_2_20070628