Go Premium for a chance to win a PS4. Enter to Win

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 218
  • Last Modified:

Optimizing Cold Fusion for Imports

We are using Cold Fusion to process data from a text file and import into a Teradata server.  We are taking 1 row at a time and importing directly into 1 field in a table.  It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute.  Does anyone have any idea how to increase the import through settings in the cold fusion administrator?  
0
jgigliotti
Asked:
jgigliotti
  • 4
  • 3
1 Solution
 
cheekycjCommented:
How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?
0
 
jgigliottiAuthor Commented:
Yes, using cffile to read from the text file.  Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.
0
 
cheekycjCommented:
you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ
0
Keep up with what's happening at Experts Exchange!

Sign up to receive Decoded, a new monthly digest with product updates, feature release info, continuing education opportunities, and more.

 
jgigliottiAuthor Commented:
That sounds like a good start - I'll give it a try and let you know!

Thanks.
0
 
cheekycjCommented:
OK.. keep me posted.. I will do some digging for other options.

CJ
0
 
jgigliottiAuthor Commented:
This seemed to help a great deal.  We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen
0
 
cheekycjCommented:
I'm glad it helped.

CJ
0

Featured Post

Keep up with what's happening at Experts Exchange!

Sign up to receive Decoded, a new monthly digest with product updates, feature release info, continuing education opportunities, and more.

  • 4
  • 3
Tackle projects and never again get stuck behind a technical roadblock.
Join Now