Start Free Trial

asked on

Efficient and Safe software To Extract URLs from a site.

Hi,

I have a list of URLs in a database and what I would like is do a comparison of the URLs that our in our database and URLs gathered from a software. The software should do the following.

1. Can crawl URLs on a given site.
2. Can export URL results to a text file or csv file.
3. Will have a way so we can exclude URLs in the URL extraction.
4. Safe and Spyware free

Already tried Gsite crawler but it seems like it is not getting all URLs. because there are URLs that are not in the result when done with the crawl. Can you recommend a software with the criteria mentioned above?

Thanks

ASKER

I also found this but I do not know if this is safe.
http://www.wimb.net/index.php?s=delphi&page=17

Great program I use it every day . Free 30 day trial unrestricted.
Offline Explorer Enterprise"
http://www.metaproducts.com/mp/mpProducts_List.asp

http://dl.filekicker.com/send/file/167627-YJTV/eesetup.exe

Selvool

ASKER

Hi selvol,

Those are downloader softwares. What I would like is just extract the URL of the pages just like Gsitecrawler.

ASKER CERTIFIED SOLUTION

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

ASKER

Any free and safe alternative? :)

Another software option is WGET.

INFO
http://gnuwin32.sourceforge.net/packages/wget.htm

Files
http://downloads.sourceforge.net/project/gnuwin32/wget/1.11.4-1/wget-1.11.4-1-setup.exe?use_mirror=softlayer
http://downloads.sourceforge.net/project/gnuwin32/wget/1.11.4-1/wget-1.11.4-1-dep.zip?use_mirror=softlayer

Regards
Selvol

SOLUTION

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

ASKER

OK, I'll try this and see what it can do.

ASKER

Will try this later on but I think this is the sopftware that we need. Thanks