Solved

spider a website to generate sitemap

Posted on 2013-06-25
2
408 Views
Last Modified: 2013-07-01
project: seo for a website where I am not given ftp access.  I need to give them a sitemap.php (not xml) that datechanges

client is satisfied with going to xml-sitemap.com and wants to use their services.

question:
is phpcrawler-0.8
the best tool to gather all the links (images,videos,php pages) of a website
0
Comment
Question by:rgb192
2 Comments
 
LVL 108

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 39275091
phpcrawler was the worst tool in my experience.  The best tool I have found is Zoom Indexer.  If you just want to copy the site, httrack will usually work.

If you want to add the sitemap to the site, this will be a deal-breaker: "where I am not given ftp access."
0
 

Author Closing Comment

by:rgb192
ID: 39290516
I read about httrack.  Thanks

zoom indexer requires installation.
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

Introduction HTML checkboxes provide the perfect way for a web developer to receive client input when the client's options might be none, one or many.  But the PHP code for processing the checkboxes can be confusing at first.  What if a checkbox is…
Consider the following scenario: You are working on a website and make something great - something that lets the server work with information submitted by your users. This could be anything, from a simple guestbook to a e-Money solution. But what…
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now