Solved

CFCOLLECTION  timeouit issue

Posted on 2008-10-30
3
203 Views
Last Modified: 2013-12-24
I have an automated process which refreshes a collection at midnight everyday, many files can be uploaded in a day, so the collection is built/rebuilt on off hours. been running for over a year but last few days have been getting a timeout in the cf log

system is CF5

is there a max size for processing a collection?
one directory being set for the collection is 1375 files totalling 734M of mixed file types, mainly PDF oterh directory being scanned has 998 files totaling 735M, again mainly PDF files

what limitations does the cfcollection have regarding number of files and or max processing size?
0
Comment
Question by:James Rodgers
  • 2
3 Comments
 
LVL 10

Expert Comment

by:Mr_Nil
ID: 22846266
K2 restrictions on CF5 were :
    * For ColdFusion Professional, K2 Server can search a maximum of 125,000 documents.
    * For ColdFusion Enterprise, K2 Server can search a maximum of 250,000 documents.


Have you tried adding a cfsetting requesttimeout in the template?

What does the time out error point to in your script? Is it cfindex or cfcollection?  If its cfcollection what action are you undertaking?
0
 
LVL 25

Author Comment

by:James Rodgers
ID: 22849488
i moved the site giving the error to a new local environment to see if i could duplicate the error locally before working on a solution for the production environment , i set up the local system with the same parameters, time, files, processes and pathways as the original system, it ran last night and i got this error

1min and 51 seconds in to the routine i get
!!  CFTrace::logThread(18780) has no entry for thread 18780

A request exceeded the timeout. The unresponsive thread count is up to 2. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm]

17 minutes and 26 seconds after routine starts i get
A long-running request returned. The unresponsive thread count is down to 1. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm].

and at 17:28
A long-running request returned. The unresponsive thread count is down to 0. [C:\CFusion\Scripts\cfexectask.cfm].



createVerityCollection.cfm is a group of commands and checks to determine if the collection already exists and to perform accordingly - make it if it doesn't, purge and update if it does, it has been running for over a year and is now having timeout issues

one option was to append the collection with each upload, problem is the users sometimes update the files, as much as 10 times in a day

>>Have you tried adding a cfsetting requesttimeout in the template?
that is only a hot fix i think and does not address the underlying issue, i could do it but next week/month if i start getting the same issue then i didn't really solve the problem and i'll be back to the beginning looking for the error/issue
0
 
LVL 10

Accepted Solution

by:
Mr_Nil earned 500 total points
ID: 22849637
To be honest - if your request is running to 17+ minutes then adding a cfsetting won't make any difference.

Does the task complete if you run it manually?

Can you still search the collection?

Have you tried deleting/remove/obliterating the existing collection and recreating it from scratch?
Its been a long time since I worked with CF5 and Verity, but I vaguely recall there being times where the collection would get corrupt, but you wouldn't necessarily know this had happened and indexing would seem to take forever.

I was about to suggest adding the update to the end of the file upload (as you mention) but to wrap it in cfthread, so that it can go off and run in the background.  But then I remembered that this is CF5 we're talking about.... :/  

0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

One of the typical problems I have experienced is when you have to move a web server from one hosting site to another. You normally prepare all on the new host, transfer the site, change DNS and cross your fingers hoping all will be ok on new server…
If you don't have the right permissions set for your WordPress location in IIS, you won't be able to perform automatic updates. Here's how to fix the problem.
This tutorial demonstrates a quick way of adding group price to multiple Magento products.
You have products, that come in variants and want to set different prices for them? Watch this micro tutorial that describes how to configure prices for Magento super attributes. Assigning simple products to configurable: We assigned simple products…

930 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now