Solved

Data ODBC connection slow to load into SQL database

Posted on 2013-05-25
10
1,178 Views
Last Modified: 2013-08-03
I have a SQL Server 2008 Enterprise Edition database running on Windows Server 2008 R2 in a major US city that is working fine when data is loaded from a server in the same city.

I have an identical server setup in India but the data from that server is loading into the database very slowly.

The connection to India is 40mb and about half utilized.

Currently we are using odbc connections at both locations but I am considering changing the India site to use bcp.

How can I tell what is causing the slow connection without just assuming it is the WAN connection?

Also will the database care that one server is using odbc and the other is using bcp?

I checked the SQL logs and there is not any obvious errors to point to anything wrong with the connection. The connection will not keep up with the amount of data that India is generating. The amount of data coming from India is much less than the server in the US is is sending to the same database.

I am thinking it is not the database because the database is processing the data from the local server quickly.

The server in India does not show that it is overloaded. CPU, memory usage is low.

Will bcp make a big difference?

Is SQL profiler the tool to use?

Thanks
0
Comment
Question by:Dragon0x40
10 Comments
 
LVL 38

Assisted Solution

by:Aaron Tomosky
Aaron Tomosky earned 125 total points
ID: 39197619
Probably latency/jitter. Try pingtest.net
0
 

Author Comment

by:Dragon0x40
ID: 39198211
I agree that Latency could be a problem but pingtest.net is the way to test your ISP speed to one of the pingtest.net servers.

I don't think you can test a WAN link between the US and India using pingtest.net?

http://www.serviceassurancedaily.com/2008/06/latency-and-jitter/
0
 
LVL 35

Assisted Solution

by:David Todd
David Todd earned 250 total points
ID: 39198284
Hi,

Why use pingtest? Why not just use the inbuilt ping?

Regards
  David
0
 

Author Comment

by:Dragon0x40
ID: 39198351
Maybe I can run wireshark on the SQL server and filter for traffic coming from the US server and compare that to a filter of the traffic coming from the India server?

Then I should be able to look for retransmissions, the amount of time between packets, errors, etc.

Of course any latency could be in the WAN link or the Server in India.

Maybe SQL profiler would be a better tool but I don't know how to use it well enough to know what to capture and what to look for.
0
6 Surprising Benefits of Threat Intelligence

All sorts of threat intelligence is available on the web. Intelligence you can learn from, and use to anticipate and prepare for future attacks.

 
LVL 35

Assisted Solution

by:David Todd
David Todd earned 250 total points
ID: 39198440
Hi,

Instead of SQL profiler, there is a netmon from MS or Performance monitor would be my suggestion. SQL Profiler will only pull out sql queries, and durations, which possibly isn't the most meaningful when trying to look at network times.

Regards
  David

PS Are there more network oriented zones that a netadmin could add to this question, that might get a more informed opinion?
0
 
LVL 68

Accepted Solution

by:
Qlemo earned 125 total points
ID: 39200846
Analyzing on SQL level won't bring you further here. Most probably you have issues with the "pipe" - TCP/IP response time, receive window, timeout/resent tracffic, and that is all network related stuff. WireShark or MS NetMon or any other Network Analysis tool can reveal the issue, but need someone experienced to interpret the results.
What will be obvious, however, are resends (retries) and missing or delayed ACKs. It sounds as if the ACKs are not sent as fast as needed, and each side is waiting for a "receipt" for transferred packets.
Also, heavy fragmentation could be an issue, leading to extensive overuse of bandwidth, or even dismissal.
0
 

Author Comment

by:Dragon0x40
ID: 39223765
Still working on this.

Will post something when I find out any new information.
0
 

Author Comment

by:Dragon0x40
ID: 39249385
Still working on this.
0
 

Author Comment

by:Dragon0x40
ID: 39379472
never figured this out so I will assign points for those that helped
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

I'm a big fan of Windows' offline folder caching and have used it on my laptops for over a decade.  One thing I don't like about it, however, is how difficult Microsoft has made it for the cache to be moved out of the Windows folder.  Here's how to …
Read about achieving the basic levels of HRIS security in the workplace.
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now