I have broken links...

Posted on 2007-11-14
Medium Priority
Last Modified: 2010-08-05
I have some broken links according to Google's webmaster tools.. having a heck of a time finding the pages that these links are broken on.  I was thinking of trying to search from inside Linux on the shell.. is there a way to search every file in a directory for these urls...for example..

/domain  <-- directory of the domain & all the files


Question by:cstormer
  • 2

Expert Comment

ID: 20283438
I would probably approach this from a client side instead of a server side. After all, there may be files that exist but are inaccessible because of a server misconfiguration. Also, there are tools to do this already clientside, where as doing this from the linux console is a less common scenario.

Here is one such program: http://home.snafu.de/tilman/xenulink.html (I'm guessing your workstation is windows, if not we can find some linux tools to do this too)

Author Comment

ID: 20283603
Ya I've been using Web Link Validator, and Xenu

I just can't seem to locate where some of these files are.. (those two client) side programs do not find the files with these broken links.... (they find thousands of links, 99.9% good) somehow google is finding about 10-15 bad ones.

Accepted Solution

bayesianmind earned 2000 total points
ID: 20284329
If the client tools find all valid links then you are fine, as there is no way a customer could get a broken link. Google's algorithm is probably finding a broken link a customer would never get.

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Cron is one of the most popular and basic utilities found on Unix systems. Combined with other tools, cron makes it exceptionally easy to automate a broad range of tasks on your server.
This article explains how to use the rsync command to create backups and sync data across hosts. Rsync is a very useful command that is often used to copy data, make backups, migrate hosts, and bridge the gap between site staging and production enviā€¦
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.

588 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question