Does anyone know where I can get a free script or program
that can list info it finds for a given URL or address?
prompt> spider http://where.com/files
and have it index and record what it finds at that address and whatever is underneath it.
It should be for Unix or Linux.