Avatar of sandshakimi
sandshakimi
Flag for United States of America asked on

Validate URLS?

www.centralasiacommerce.com

This is a business directory, listing links to various sites. Some links have been added a while back. Is there a tool that can scan the site and validate that all the URLs are still valid and work?

Plus: Can such tools verify that the company URL is unchanged?  i.e. that if the company is doing a redirect to a new domain?
PHPMySQL Server

Avatar of undefined
Last Comment
sandshakimi

8/22/2022 - Mon
SOLUTION
Daniel Wilson

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
Ray Paseur

This is a question with a lot of "latitude" in the answer.  Please see the PHP answer to FILTER_VALIDATE_URL on this page.
http://php.net/manual/en/filter.filters.validate.php

To scan the site, you might want to consider using a screen scraper.  Any experienced PHP programmer can write one for you.  I'll give it a try as time permits and post back here if I can get a good result.  But I'm not optimistic.  When I clicked the Tajikstan link in the header it seemed to take forever to get a response.

To detect what is changed and unchanged you need you have your own database of baseline and current URLs.

You may also want to apply some "human intelligence" to this project.  For example, see http://www.famfamfam.com/ which is listed under web development.  The link works, but the site itself appears to have entered the steady state in 2006.  A lot has changed since then!
SOLUTION
Julian Hansen

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
ASKER CERTIFIED SOLUTION
Ray Paseur

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
sandshakimi

ASKER
All this is good feedback for me to
Your help has saved me hundreds of hours of internet surfing.
fblack61