Solved

Data ODBC connection slow to load into SQL database

Posted on 2013-05-25
10
1,183 Views
Last Modified: 2013-08-03
I have a SQL Server 2008 Enterprise Edition database running on Windows Server 2008 R2 in a major US city that is working fine when data is loaded from a server in the same city.

I have an identical server setup in India but the data from that server is loading into the database very slowly.

The connection to India is 40mb and about half utilized.

Currently we are using odbc connections at both locations but I am considering changing the India site to use bcp.

How can I tell what is causing the slow connection without just assuming it is the WAN connection?

Also will the database care that one server is using odbc and the other is using bcp?

I checked the SQL logs and there is not any obvious errors to point to anything wrong with the connection. The connection will not keep up with the amount of data that India is generating. The amount of data coming from India is much less than the server in the US is is sending to the same database.

I am thinking it is not the database because the database is processing the data from the local server quickly.

The server in India does not show that it is overloaded. CPU, memory usage is low.

Will bcp make a big difference?

Is SQL profiler the tool to use?

Thanks
0
Comment
Question by:Dragon0x40
10 Comments
 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 125 total points
ID: 39197619
Probably latency/jitter. Try pingtest.net
0
 

Author Comment

by:Dragon0x40
ID: 39198211
I agree that Latency could be a problem but pingtest.net is the way to test your ISP speed to one of the pingtest.net servers.

I don't think you can test a WAN link between the US and India using pingtest.net?

http://www.serviceassurancedaily.com/2008/06/latency-and-jitter/
0
 
LVL 35

Assisted Solution

by:David Todd
David Todd earned 250 total points
ID: 39198284
Hi,

Why use pingtest? Why not just use the inbuilt ping?

Regards
  David
0
What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

 

Author Comment

by:Dragon0x40
ID: 39198351
Maybe I can run wireshark on the SQL server and filter for traffic coming from the US server and compare that to a filter of the traffic coming from the India server?

Then I should be able to look for retransmissions, the amount of time between packets, errors, etc.

Of course any latency could be in the WAN link or the Server in India.

Maybe SQL profiler would be a better tool but I don't know how to use it well enough to know what to capture and what to look for.
0
 
LVL 35

Assisted Solution

by:David Todd
David Todd earned 250 total points
ID: 39198440
Hi,

Instead of SQL profiler, there is a netmon from MS or Performance monitor would be my suggestion. SQL Profiler will only pull out sql queries, and durations, which possibly isn't the most meaningful when trying to look at network times.

Regards
  David

PS Are there more network oriented zones that a netadmin could add to this question, that might get a more informed opinion?
0
 
LVL 69

Accepted Solution

by:
Qlemo earned 125 total points
ID: 39200846
Analyzing on SQL level won't bring you further here. Most probably you have issues with the "pipe" - TCP/IP response time, receive window, timeout/resent tracffic, and that is all network related stuff. WireShark or MS NetMon or any other Network Analysis tool can reveal the issue, but need someone experienced to interpret the results.
What will be obvious, however, are resends (retries) and missing or delayed ACKs. It sounds as if the ACKs are not sent as fast as needed, and each side is waiting for a "receipt" for transferred packets.
Also, heavy fragmentation could be an issue, leading to extensive overuse of bandwidth, or even dismissal.
0
 

Author Comment

by:Dragon0x40
ID: 39223765
Still working on this.

Will post something when I find out any new information.
0
 

Author Comment

by:Dragon0x40
ID: 39249385
Still working on this.
0
 

Author Comment

by:Dragon0x40
ID: 39379472
never figured this out so I will assign points for those that helped
0

Featured Post

Simplifying Server Workload Migrations

This use case outlines the migration challenges that organizations face and how the Acronis AnyData Engine supports physical-to-physical (P2P), physical-to-virtual (P2V), virtual to physical (V2P), and cross-virtual (V2V) migration scenarios to address these challenges.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will get to know that how can we recover deleted data if it happens accidently. We really can recover deleted rows if we know the time when data is deleted by using the transaction log.
These days, all we hear about hacktivists took down so and so websites and retrieved thousands of user’s data. One of the techniques to get unauthorized access to database is by performing SQL injection. This article is quite lengthy which gives bas…
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

810 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question