Solved

Optimizing Cold Fusion for Imports

Posted on 2001-08-13
7
214 Views
Last Modified: 2013-12-24
We are using Cold Fusion to process data from a text file and import into a Teradata server.  We are taking 1 row at a time and importing directly into 1 field in a table.  It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute.  Does anyone have any idea how to increase the import through settings in the cold fusion administrator?  
0
Comment
Question by:jgigliotti
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 3
7 Comments
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380629
How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?
0
 

Author Comment

by:jgigliotti
ID: 6380639
Yes, using cffile to read from the text file.  Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380703
you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ
0
 Database Backup and Recovery Best Practices

Join Percona’s, Architect, Manjot Singh as he presents Database Backup and Recovery Best Practices (with a Focus on MySQL) on Thursday, July 27, 2017 at 11:00 am PDT / 2:00 pm EDT (UTC-7). In the case of a failure, do you know how long it will take to restore your database?

 

Author Comment

by:jgigliotti
ID: 6380911
That sounds like a good start - I'll give it a try and let you know!

Thanks.
0
 
LVL 19

Accepted Solution

by:
cheekycj earned 200 total points
ID: 6380919
OK.. keep me posted.. I will do some digging for other options.

CJ
0
 

Author Comment

by:jgigliotti
ID: 6396945
This seemed to help a great deal.  We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6397073
I'm glad it helped.

CJ
0

Featured Post

Do you have a plan for Continuity?

It's inevitable. People leave organizations creating a gap in your service. That's where Percona comes in.

See how Pepper.com relies on Percona to:
-Manage their database
-Guarantee data safety and protection
-Provide database expertise that is available for any situation

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Most ColdFusion developers get confused between the CFSet, Duplicate, and Structcopy methods of copying a Structure, especially which one to use when. This Article will explain the differences in the approaches with examples; therefore, after readin…
When it comes to security, close monitoring is a must. According to WhiteHat Security annual report, a substantial number of all web applications are vulnerable always. Monitis offers a new product - fully-featured Website security monitoring and pr…
In this video, viewers are given an introduction to using the Windows 10 Snipping Tool, how to quickly locate it when it's needed and also how make it always available with a single click of a mouse button, by pinning it to the Desktop Task Bar. Int…
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…

635 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question