Solved

spider a website to generate sitemap

Posted on 2013-06-25
2
436 Views
Last Modified: 2013-07-01
project: seo for a website where I am not given ftp access.  I need to give them a sitemap.php (not xml) that datechanges

client is satisfied with going to xml-sitemap.com and wants to use their services.

question:
is phpcrawler-0.8
the best tool to gather all the links (images,videos,php pages) of a website
0
Comment
Question by:rgb192
2 Comments
 
LVL 109

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 39275091
phpcrawler was the worst tool in my experience.  The best tool I have found is Zoom Indexer.  If you just want to copy the site, httrack will usually work.

If you want to add the sitemap to the site, this will be a deal-breaker: "where I am not given ftp access."
0
 

Author Closing Comment

by:rgb192
ID: 39290516
I read about httrack.  Thanks

zoom indexer requires installation.
0

Featured Post

Does Powershell have you tied up in knots?

Managing Active Directory does not always have to be complicated.  If you are spending more time trying instead of doing, then it's time to look at something else. For nearly 20 years, AD admins around the world have used one tool for day-to-day AD management: Hyena. Discover why

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Deprecated and Headed for the Dustbin By now, you have probably heard that some PHP features, while convenient, can also cause PHP security problems.  This article discusses one of those, called register_globals.  It is a thing you do not want.  …
Since pre-biblical times, humans have sought ways to keep secrets, and share the secrets selectively.  This article explores the ways PHP can be used to hide and encrypt information.
The viewer will learn how to create and use a small PHP class to apply a watermark to an image. This video shows the viewer the setup for the PHP watermark as well as important coding language. Continue to Part 2 to learn the core code used in creat…
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question