Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

CFCOLLECTION  timeouit issue

Posted on 2008-10-30
3
Medium Priority
?
211 Views
Last Modified: 2013-12-24
I have an automated process which refreshes a collection at midnight everyday, many files can be uploaded in a day, so the collection is built/rebuilt on off hours. been running for over a year but last few days have been getting a timeout in the cf log

system is CF5

is there a max size for processing a collection?
one directory being set for the collection is 1375 files totalling 734M of mixed file types, mainly PDF oterh directory being scanned has 998 files totaling 735M, again mainly PDF files

what limitations does the cfcollection have regarding number of files and or max processing size?
0
Comment
Question by:James Rodgers
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 10

Expert Comment

by:Mr_Nil
ID: 22846266
K2 restrictions on CF5 were :
    * For ColdFusion Professional, K2 Server can search a maximum of 125,000 documents.
    * For ColdFusion Enterprise, K2 Server can search a maximum of 250,000 documents.


Have you tried adding a cfsetting requesttimeout in the template?

What does the time out error point to in your script? Is it cfindex or cfcollection?  If its cfcollection what action are you undertaking?
0
 
LVL 25

Author Comment

by:James Rodgers
ID: 22849488
i moved the site giving the error to a new local environment to see if i could duplicate the error locally before working on a solution for the production environment , i set up the local system with the same parameters, time, files, processes and pathways as the original system, it ran last night and i got this error

1min and 51 seconds in to the routine i get
!!  CFTrace::logThread(18780) has no entry for thread 18780

A request exceeded the timeout. The unresponsive thread count is up to 2. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm]

17 minutes and 26 seconds after routine starts i get
A long-running request returned. The unresponsive thread count is down to 1. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm].

and at 17:28
A long-running request returned. The unresponsive thread count is down to 0. [C:\CFusion\Scripts\cfexectask.cfm].



createVerityCollection.cfm is a group of commands and checks to determine if the collection already exists and to perform accordingly - make it if it doesn't, purge and update if it does, it has been running for over a year and is now having timeout issues

one option was to append the collection with each upload, problem is the users sometimes update the files, as much as 10 times in a day

>>Have you tried adding a cfsetting requesttimeout in the template?
that is only a hot fix i think and does not address the underlying issue, i could do it but next week/month if i start getting the same issue then i didn't really solve the problem and i'll be back to the beginning looking for the error/issue
0
 
LVL 10

Accepted Solution

by:
Mr_Nil earned 1500 total points
ID: 22849637
To be honest - if your request is running to 17+ minutes then adding a cfsetting won't make any difference.

Does the task complete if you run it manually?

Can you still search the collection?

Have you tried deleting/remove/obliterating the existing collection and recreating it from scratch?
Its been a long time since I worked with CF5 and Verity, but I vaguely recall there being times where the collection would get corrupt, but you wouldn't necessarily know this had happened and indexing would seem to take forever.

I was about to suggest adding the update to the end of the file upload (as you mention) but to wrap it in cfthread, so that it can go off and run in the background.  But then I remembered that this is CF5 we're talking about.... :/  

0

Featured Post

Will your db performance match your db growth?

In Percona’s white paper “Performance at Scale: Keeping Your Database on Its Toes,” we take a high-level approach to what you need to think about when planning for database scalability.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A web service (http://en.wikipedia.org/wiki/Web_service) is a software related technology that facilitates machine-to-machine interaction over a network. This article helps beginners in creating and consuming a web service using the ColdFusion Ma…
Most ColdFusion developers get confused between the CFSet, Duplicate, and Structcopy methods of copying a Structure, especially which one to use when. This Article will explain the differences in the approaches with examples; therefore, after readin…
This course is ideal for IT System Administrators working with VMware vSphere and its associated products in their company infrastructure. This course teaches you how to install and maintain this virtualization technology to store data, prevent vuln…
Do you want to know how to make a graph with Microsoft Access? First, create a query with the data for the chart. Then make a blank form and add a chart control. This video also shows how to change what data is displayed on the graph as well as form…

670 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question