Solved

spider a website to generate sitemap

Posted on 2013-06-25
2
458 Views
Last Modified: 2013-07-01
project: seo for a website where I am not given ftp access.  I need to give them a sitemap.php (not xml) that datechanges

client is satisfied with going to xml-sitemap.com and wants to use their services.

question:
is phpcrawler-0.8
the best tool to gather all the links (images,videos,php pages) of a website
0
Comment
Question by:rgb192
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 
LVL 110

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 39275091
phpcrawler was the worst tool in my experience.  The best tool I have found is Zoom Indexer.  If you just want to copy the site, httrack will usually work.

If you want to add the sitemap to the site, this will be a deal-breaker: "where I am not given ftp access."
0
 

Author Closing Comment

by:rgb192
ID: 39290516
I read about httrack.  Thanks

zoom indexer requires installation.
0

Featured Post

Online Training Solution

Drastically shorten your training time with WalkMe's advanced online training solution that Guides your trainees to action. Forget about retraining and skyrocket knowledge retention rates.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
What is this? I've never seen this... 2 29
Make login page safer 3 32
Converting PHP triple des decrypt to c# 9 75
HTTPS for signup & login - HTTP for all other pages 10 51
Developers of all skill levels should learn to use current best practices when developing websites. However many developers, new and old, fall into the trap of using deprecated features because this is what so many tutorials and books tell them to u…
Password hashing is better than message digests or encryption, and you should be using it instead of message digests or encryption.  Find out why and how in this article, which supplements the original article on PHP Client Registration, Login, Logo…
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.
The viewer will learn how to create and use a small PHP class to apply a watermark to an image. This video shows the viewer the setup for the PHP watermark as well as important coding language. Continue to Part 2 to learn the core code used in creat…

733 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question