Efficient and Safe software To Extract URLs from a site.

That software is a downloader indeed. But that is just  part of it.  It will extract the URL's.    Just make a project and add the starting URL of the site and any more start points.  In properties Uncheck all the boxes such as text etc.. Check with in the same server and leave the depth unchecked.     Scan the site. When done goto to (top Menu; Create site map)  It will spit out a text file with all the URL of that site. And nothing is Downloaded but the sites structure.  

See attached image for a visual explanation.

I am not trying to push the software. As I get nothing out of it. I am not sure what your needs are but I can tell you from experience with this software. It is top notch and worth the $500 price tag.

But as I said 30 day unrestricted no Adware no spyware. ANd a great software company behind it.

Try it you can . If not I hope you find the right software .

Another software option is WGET.  

Regards

Selvol

Here's a cheat sheet. Its old but it should work with the newer WGET.  This should get you started.

Display all help: wget --help
Completely mirror a site: wget -mr -r -A.gif http://www.domain.com/Folder/
-m: mirror
-r: recursive
Mirror without following links to other servers, parent directories: wget -mrnp http://...
-np: no-parent
Retrieve a html file and convert relative links to absolute ones: wget -k http://users.ugent.be/~bpuype/wget
-k: 'k'onvert links
Resume partially downloaded files (if supported by the server): wget -c http://...
-c: continue
Read url's from a file and retrieve them: wget -i file_with_urls.txt
-i: input-file
Ask for url's (read from stdin): wget -i -. Enter url's on the command line, press enter after each url, and terminate with ^Z (press CTRL-Z) on an empty line.
FTP
--glob=off
Don't treat (, *, ? etc. as globbing characters. Use when transfering files with names that contain these characters.
--passive-ftp
Use passive mode for data connection (try this if you're behind a firewall, NAT box...)
Proxy
To make wget use a proxy, you must set up an environment variable before using wget. Type this at the command prompt:
set http_proxy=http://proxy.myprovider.net:8080
...where you use the correct proxy hostname and port for your ISP or network. You can use ftp_proxy to proxy ftp requests.
--proxy=on
--proxy=off

Turn proxy usage on/off once variable is set; default is on when variable is present.
Passwords
To retrieve with passwords (http or ftp), you can use the following url syntax:
wget http://username:password@www.example.net/somedir/somefile
wget ftp://username:password@ftp.example.net/somedir/somefile

Additionally, you can also use --http-user, --http-password as well as --ftp-user, --ftp-password:
wget ftp://ftp.example.net/somefile --ftp-user=username --ftp-password=password
If username or password contain non-alphanumeric characters, you need to escape them when passing them in urls (rfc1738 %HH) syntax. For example, with a username of user@domain and password of pass, your url becomes http://user%40domain:pass@www.example.net/somefile. When using escaped urls in batch files, remember that % itself is a special character, and needs to be escaped itself (by using %% instead of %).

SElvol