jConnect bulk instert

Posted on 2011-05-09
Last Modified: 2012-05-11
We are trying to insert some data into Sybase ASE (15.0.3) using java application (jConnect 7.0). We would like to use bulk insert, so we set ENABLE_BULK_LOAD and use prepared insert statements and batch updates.

We have reached approximately 10x faster inserts when compared with normal inserts without bulk load and batch updates. But it is still 10x slower than using bcp utility. Tested on the same system, with the same data and tables without indexes.

Is this the limit for jConnect bulk load ? Or did you succeed to reach the same speed as bcp utility ?
Question by:Jan_Franek
    LVL 92

    Expert Comment

    think you'll find its a limitation of jdbc. The extra layers involved with jdbc make it unable to match the performance of more native tools.
    LVL 47

    Expert Comment

    I notice the same thing with Oracle, though not that dramatic

    I also think that even if you are running it all on the server jdbc's design assumes
    network interactions and this also causes slowdown.
    LVL 13

    Expert Comment

    The huge difference might be because of batch size. I don't know how it works with Java, but the actual batch size might be too small to make the speed comparable with bcp.
    LVL 14

    Accepted Solution

    Batch size doesn't matter - bcp utility is still 10x faster, even with the same batch size.

    OK, thank for input, but it's only general information without any useful specific experience with my situation. So I'll ask EE to close the question.
    LVL 14

    Author Closing Comment

    No useful information.

    Featured Post

    IT, Stop Being Called Into Every Meeting

    Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

    Join & Write a Comment

    Java had always been an easily readable and understandable language.  Some relatively recent changes in the language seem to be changing this pretty fast, and anyone that had not seen any Java code for the last 5 years will possibly have issues unde…
    Introduction This article is the last of three articles that explain why and how the Experts Exchange QA Team does test automation for our web site. This article covers our test design approach and then goes through a simple test case example, how …
    Viewers will learn about if statements in Java and their use The if statement: The condition required to create an if statement: Variations of if statements: An example using if statements:
    Viewers will learn about the regular for loop in Java and how to use it. Definition: Break the for loop down into 3 parts: Syntax when using for loops: Example using a for loop:

    734 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    21 Experts available now in Live!

    Get 1:1 Help Now