Solved

I have broken links...

Posted on 2007-11-14
3
324 Views
Last Modified: 2010-08-05
I have some broken links according to Google's webmaster tools.. having a heck of a time finding the pages that these links are broken on.  I was thinking of trying to search from inside Linux on the shell.. is there a way to search every file in a directory for these urls...for example..

/domain  <-- directory of the domain & all the files

http://domain.com/file.phps




0
Comment
Question by:cstormer
  • 2
3 Comments
 
LVL 3

Expert Comment

by:bayesianmind
ID: 20283438
I would probably approach this from a client side instead of a server side. After all, there may be files that exist but are inaccessible because of a server misconfiguration. Also, there are tools to do this already clientside, where as doing this from the linux console is a less common scenario.

Here is one such program: http://home.snafu.de/tilman/xenulink.html (I'm guessing your workstation is windows, if not we can find some linux tools to do this too)
0
 

Author Comment

by:cstormer
ID: 20283603
Ya I've been using Web Link Validator, and Xenu

I just can't seem to locate where some of these files are.. (those two client) side programs do not find the files with these broken links.... (they find thousands of links, 99.9% good) somehow google is finding about 10-15 bad ones.
0
 
LVL 3

Accepted Solution

by:
bayesianmind earned 500 total points
ID: 20284329
If the client tools find all valid links then you are fine, as there is no way a customer could get a broken link. Google's algorithm is probably finding a broken link a customer would never get.
0

Featured Post

Migrating Your Company's PCs

To keep pace with competitors, businesses must keep employees productive, and that means providing them with the latest technology. This document provides the tips and tricks you need to help you migrate an outdated PC fleet to new desktops, laptops, and tablets.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
High Bandwidth Usage 6 58
Backup & Restore 3 56
Choosing CentOS 16 82
How to install a renewed SSL certificate on Windows 2012 server 7 74
Linux users are sometimes dumbfounded by the severe lack of documentation on a topic. Sometimes, the documentation is copious, but other times, you end up with some obscure "it varies depending on your distribution" over and over when searching for …
Fine Tune your automatic Updates for Ubuntu / Debian
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:

810 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question