asked on

Optimizing Cold Fusion for Imports

We are using Cold Fusion to process data from a text file and import into a Teradata server. We are taking 1 row at a time and importing directly into 1 field in a table. It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute. Does anyone have any idea how to increase the import through settings in the cold fusion administrator?

cheekycj

How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?

jgigliotti

ASKER

Yes, using cffile to read from the text file. Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.

cheekycj

you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ

jgigliotti

ASKER

That sounds like a good start - I'll give it a try and let you know!

Thanks.

ASKER CERTIFIED SOLUTION

cheekycj

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

jgigliotti

ASKER

This seemed to help a great deal. We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen

cheekycj

I'm glad it helped.

CJ