Solved

Optimizing Cold Fusion for Imports

Posted on 2001-08-13
7
208 Views
Last Modified: 2013-12-24
We are using Cold Fusion to process data from a text file and import into a Teradata server.  We are taking 1 row at a time and importing directly into 1 field in a table.  It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute.  Does anyone have any idea how to increase the import through settings in the cold fusion administrator?  
0
Comment
Question by:jgigliotti
  • 4
  • 3
7 Comments
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380629
How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?
0
 

Author Comment

by:jgigliotti
ID: 6380639
Yes, using cffile to read from the text file.  Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380703
you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ
0
U.S. Department of Agriculture and Acronis Access

With the new era of mobile computing, smartphones and tablets, wireless communications and cloud services, the USDA sought to take advantage of a mobilized workforce and the blurring lines between personal and corporate computing resources.

 

Author Comment

by:jgigliotti
ID: 6380911
That sounds like a good start - I'll give it a try and let you know!

Thanks.
0
 
LVL 19

Accepted Solution

by:
cheekycj earned 200 total points
ID: 6380919
OK.. keep me posted.. I will do some digging for other options.

CJ
0
 

Author Comment

by:jgigliotti
ID: 6396945
This seemed to help a great deal.  We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6397073
I'm glad it helped.

CJ
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Have you ever sent email via ColdFusion and thought of tracking this mail to capture the exact date and time when the message was opened ?  If yes, then this article is for you ! First we need a table user_email with columns user_id , email , sub…
Introduction This article explores the design of a cache system that can improve the performance of a web site or web application.  The assumption is that the web site has many more “read” operations than “write” operations (this is commonly the ca…
A company’s greatest vulnerability is their email. CEO fraud, ransomware and spear phishing attacks are the no1 threat to a company’s security. Cybercrime is responsible for the largest loss of money to companies today with losses projected to r…
With Secure Portal Encryption, the recipient is sent a link to their email address directing them to the email laundry delivery page. From there, the recipient will be required to enter a user name and password to enter the page. Once the recipient …

932 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now