Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

Optimizing Cold Fusion for Imports

Posted on 2001-08-13
7
Medium Priority
?
217 Views
Last Modified: 2013-12-24
We are using Cold Fusion to process data from a text file and import into a Teradata server.  We are taking 1 row at a time and importing directly into 1 field in a table.  It was running at about 60 records per minute, but has recently slowed to about 40-45 records per minute.  Does anyone have any idea how to increase the import through settings in the cold fusion administrator?  
0
Comment
Question by:jgigliotti
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 3
7 Comments
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380629
How are you reading your data in?

Are you using CFFILE to read in the data?

How are you moving the data to the Teradata server?
0
 

Author Comment

by:jgigliotti
ID: 6380639
Yes, using cffile to read from the text file.  Placing each row into a variable using cfset and then using "insert into " and cfquery to insert into teradata.
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6380703
you can try increasing your max connections in CF Admin to allow the CF Server to do more connection pooling but with inserts I am not sure how much it will help.

maybe you want to read in multiple rows and insert multiple rows using one query command (if TerraData allows it) thus using less connections and the making it more efficient in using the connections.

CJ
0
Does Your Cloud Backup Use Blockchain Technology?

Blockchain technology has already revolutionized finance thanks to Bitcoin. Now it's disrupting other areas, including the realm of data protection. Learn how blockchain is now being used to authenticate backup files and keep them safe from hackers.

 

Author Comment

by:jgigliotti
ID: 6380911
That sounds like a good start - I'll give it a try and let you know!

Thanks.
0
 
LVL 19

Accepted Solution

by:
cheekycj earned 800 total points
ID: 6380919
OK.. keep me posted.. I will do some digging for other options.

CJ
0
 

Author Comment

by:jgigliotti
ID: 6396945
This seemed to help a great deal.  We are running batches in queries of 100 at a time and before seeing the final product - I can already tell how the speed has increased!

Thanks for your help!

Jen
0
 
LVL 19

Expert Comment

by:cheekycj
ID: 6397073
I'm glad it helped.

CJ
0

Featured Post

New benefit for Premium Members - Upgrade now!

Ready to get started with anonymous questions today? It's easy! Learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Periodically we have to update or add SSL certificates for customers. Depending upon your hosting plan you may be responsible for the installation and/or key generation. In the wake of Heartbleed many sites were forced to re-key. We will concen…
When it comes to showing a 404 error page to your visitors, you do not want that generic page to show, and you especially do not want your hosting provider’s ad error page to show either. In this article, I will show you how to enable the custom 40…
This is my first video review of Microsoft Bookings, I will be doing a part two with a bit more information, but wanted to get this out to you folks.
In this video you will find out how to export Office 365 mailboxes using the built in eDiscovery tool. Bear in mind that although this method might be useful in some cases, using PST files as Office 365 backup is troublesome in a long run (more on t…
Suggested Courses

704 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question