A way to alert that crawling has finished?

Posted on 2011-09-29
Medium Priority
Last Modified: 2012-05-12
A way to alert that crawling has finished?

I have this website downloader in visual c# which runs and finishes downloading files.
I am trying to find a way to alert that crawling has finished.

This download is multithreading.
Basically it parses URI given and find files insert those URIs in a queue.
Each thread takes one URI from the queue and start downloading it.

So I tried to count activeURICount which is a URI trying to download.
If there are no activeURI and queue is empty, I know that crawling is done.

But I am getting StackOverFlowException.

Is there another way you can think of to alert the crawling has finished?
Question by:dkim18
  • 3

Author Comment

ID: 36814917
WebsiteCrawler.exe!Crawler.WebsiteCrawler.DequeueUri() Line 1076      C#
       WebsiteCrawler.exe!Crawler.WebsiteCrawler.ThreadRunFunction() Line 1001 + 0xc bytes      C#
       mscorlib.dll!System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, object state) + 0x9b bytes      
       mscorlib.dll!System.Threading.ThreadHelper.ThreadStart() + 0x4d bytes      

Accepted Solution

dkim18 earned 0 total points
ID: 36815467
Found my own solution.
The problem was from my property.

private int nMyCount
private int MyCount

Then I did MyCount++.

Author Closing Comment

ID: 36815469
Found my own solution.

Featured Post

Free Tool: SSL Checker

Scans your site and returns information about your SSL implementation and certificate. Helpful for debugging and validating your SSL configuration.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

In order to hide the "ugly" records selectors (triangles) in the rowheaders, here are some suggestions. Microsoft doesn't have a direct method/property to do it. You can only hide the rowheader column. First solution, the easy way The first sol…
We all know that functional code is the leg that any good program stands on when it comes right down to it, however, if your program lacks a good user interface your product may not have the appeal needed to keep your customers happy. This issue can…
Watch the video to know how one can repair corrupt Exchange OST file effortlessly and convert OST emails to MS Outlook PST file format by using Kernel for OST to PST converter tool. It can convert OST to MSG, MBOX, EML to access them. It can migrate…
Watch the video of Kernel Migrator for SharePoint, which demonstrate the process easily of migration from SharePoint to SharePoint, OneDrive for Business & Google Drive servers, Public Folder to SharePoint, File Server to SharePoint. The tool has va…

624 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question