• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 561
  • Last Modified:

spider a website to generate sitemap

project: seo for a website where I am not given ftp access.  I need to give them a sitemap.php (not xml) that datechanges

client is satisfied with going to xml-sitemap.com and wants to use their services.

question:
is phpcrawler-0.8
the best tool to gather all the links (images,videos,php pages) of a website
0
rgb192
Asked:
rgb192
1 Solution
 
Ray PaseurCommented:
phpcrawler was the worst tool in my experience.  The best tool I have found is Zoom Indexer.  If you just want to copy the site, httrack will usually work.

If you want to add the sitemap to the site, this will be a deal-breaker: "where I am not given ftp access."
0
 
rgb192Author Commented:
I read about httrack.  Thanks

zoom indexer requires installation.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now