Solved

CFCOLLECTION  timeouit issue

Posted on 2008-10-30
3
207 Views
Last Modified: 2013-12-24
I have an automated process which refreshes a collection at midnight everyday, many files can be uploaded in a day, so the collection is built/rebuilt on off hours. been running for over a year but last few days have been getting a timeout in the cf log

system is CF5

is there a max size for processing a collection?
one directory being set for the collection is 1375 files totalling 734M of mixed file types, mainly PDF oterh directory being scanned has 998 files totaling 735M, again mainly PDF files

what limitations does the cfcollection have regarding number of files and or max processing size?
0
Comment
Question by:James Rodgers
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 10

Expert Comment

by:Mr_Nil
ID: 22846266
K2 restrictions on CF5 were :
    * For ColdFusion Professional, K2 Server can search a maximum of 125,000 documents.
    * For ColdFusion Enterprise, K2 Server can search a maximum of 250,000 documents.


Have you tried adding a cfsetting requesttimeout in the template?

What does the time out error point to in your script? Is it cfindex or cfcollection?  If its cfcollection what action are you undertaking?
0
 
LVL 25

Author Comment

by:James Rodgers
ID: 22849488
i moved the site giving the error to a new local environment to see if i could duplicate the error locally before working on a solution for the production environment , i set up the local system with the same parameters, time, files, processes and pathways as the original system, it ran last night and i got this error

1min and 51 seconds in to the routine i get
!!  CFTrace::logThread(18780) has no entry for thread 18780

A request exceeded the timeout. The unresponsive thread count is up to 2. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm]

17 minutes and 26 seconds after routine starts i get
A long-running request returned. The unresponsive thread count is down to 1. [Drive:\server\sitename\website\path\search\createVerityCollection.cfm].

and at 17:28
A long-running request returned. The unresponsive thread count is down to 0. [C:\CFusion\Scripts\cfexectask.cfm].



createVerityCollection.cfm is a group of commands and checks to determine if the collection already exists and to perform accordingly - make it if it doesn't, purge and update if it does, it has been running for over a year and is now having timeout issues

one option was to append the collection with each upload, problem is the users sometimes update the files, as much as 10 times in a day

>>Have you tried adding a cfsetting requesttimeout in the template?
that is only a hot fix i think and does not address the underlying issue, i could do it but next week/month if i start getting the same issue then i didn't really solve the problem and i'll be back to the beginning looking for the error/issue
0
 
LVL 10

Accepted Solution

by:
Mr_Nil earned 500 total points
ID: 22849637
To be honest - if your request is running to 17+ minutes then adding a cfsetting won't make any difference.

Does the task complete if you run it manually?

Can you still search the collection?

Have you tried deleting/remove/obliterating the existing collection and recreating it from scratch?
Its been a long time since I worked with CF5 and Verity, but I vaguely recall there being times where the collection would get corrupt, but you wouldn't necessarily know this had happened and indexing would seem to take forever.

I was about to suggest adding the update to the end of the file upload (as you mention) but to wrap it in cfthread, so that it can go off and run in the background.  But then I remembered that this is CF5 we're talking about.... :/  

0

Featured Post

Back Up Your Microsoft Windows Server®

Back up all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you don't have the right permissions set for your WordPress location in IIS, you won't be able to perform automatic updates. Here's how to fix the problem.
Lease-to-own eliminates the expenditure of hardware replacement and allows you to pay off the server over time. Usually, this is much cheaper than leasing servers. Think of lease-to-own as credit without interest.
Nobody understands Phishing better than an anti-spam company. That’s why we are providing Phishing Awareness Training to our customers. According to a report by Verizon, only 3% of targeted users report malicious emails to management. With compan…
Finds all prime numbers in a range requested and places them in a public primes() array. I've demostrated a template size of 30 (2 * 3 * 5) but larger templates can be built such 210  (2 * 3 * 5 * 7) or 2310  (2 * 3 * 5 * 7 * 11). The larger templa…

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question