how can i find the index of all downloads for a site

excelismagic
excelismagic used Ask the Experts™
on
some websites, change their links and then they forget to update the broken links.

for example the link in this page http://www.xldynamic.com/source/xld.XtraTime.html  refers to http://xldynamic.com/cgi-bin/counters/unicounter.pl?name=xld.XtraTime.dl&cache=0&deliver=http://www.xldynamic.com/downloads/xld.XtraTime.zip

which does not work and if i remove the some part of the link and only leave http://www.xldynamic.com/downloads/xld.XtraTime.zip

it will work and will download.

i was wondering if there is a easy way to find the list of all publicly available download links for a website.

i used to work with www.websitename.com/index.html long time ago, but that does not work anymore.

any idea how to get the list of download links for a website?
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Michel PlungjanIT Expert
Top Expert 2009

Commented:
Do you mean

site: www.xldynamic.com/downloads/ ?

Author

Commented:
yes something like that, but it tells me access denied.

the owner of the site is Bob Philip, he himself got the website back, he also confirms that he still needs to fix the download links.

here is his post on the top confirming it https://groups.google.com/forum/#!topic/microsoft.public.excel/1R4K_a7OThA

i am trying to find a way, how can i get use Expert's brain here, so that i get the list of all download links .
Microsoft Excel Expert
Top Expert 2014
Commented:
i think you got your answer in another question here  it is obvious the website uses Robots_exclusion_standard and does not allow access to index directory.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial