Solved

Optimizing Cold Fusion for Imports

Posted on 2001-08-13
7
207 Views
Last Modified: 2013-12-24
We are using Cold Fusion to process data from a text file and import into a Teradata server.  We are taking 1 row at a time and importing directly into 1 field in a table.  It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute.  Does anyone have any idea how to increase the import through settings in the cold fusion administrator?  
0
Comment
Question by:jgigliotti
  • 4
  • 3
7 Comments
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380629
How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?
0
 

Author Comment

by:jgigliotti
ID: 6380639
Yes, using cffile to read from the text file.  Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380703
you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ
0
Network it in WD Red

There's an industry-leading WD Red drive for every compatible NAS system to help fulfill your data storage needs. With drives up to 8TB, WD Red offers a wide array of solutions for customers looking to build the biggest, best-performing NAS storage solution.  

 

Author Comment

by:jgigliotti
ID: 6380911
That sounds like a good start - I'll give it a try and let you know!

Thanks.
0
 
LVL 19

Accepted Solution

by:
cheekycj earned 200 total points
ID: 6380919
OK.. keep me posted.. I will do some digging for other options.

CJ
0
 

Author Comment

by:jgigliotti
ID: 6396945
This seemed to help a great deal.  We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6397073
I'm glad it helped.

CJ
0

Featured Post

Why You Should Analyze Threat Actor TTPs

After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

Join & Write a Comment

If you don't have the right permissions set for your WordPress location in IIS, you won't be able to perform automatic updates. Here's how to fix the problem.
Meet the world's only “Transparent Cloud™” from Superb Internet Corporation. Now, you can experience firsthand a cloud platform that consistently outperforms Amazon Web Services (AWS), IBM’s Softlayer, and Microsoft’s Azure when it comes to CPU and …
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

25 Experts available now in Live!

Get 1:1 Help Now