Go Premium for a chance to win a PS4. Enter to Win

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 440
  • Last Modified:

Is their any way to find broken URL's?

Is their any way to find broken URL's?

We deleted 100's of URL's of our site and Google shows a lot of them still

I want a way to find out all such URL's that are still live in Google but actually deleted

Any script or tool to find this?
0
bsharath
Asked:
bsharath
5 Solutions
 
Scott Fell, EE MVEDeveloperCommented:
Where the old urls built dynamically and not you are using some other way to dynamically build urls?

If that is the case, I would create vb script to watch for those patterns either on a page like

<%
theQuerystring=request.querystring

if some variable = x then
   newQstring=z
end if

' Permanent redirection
Response.Status = "301 Moved Permanently"
Response.AddHeader "Location", "http://www.mysite.com/newpage.asp?q="&newQstring
Response.End
%>

Or use pattern matching in iis 301 redirect

Otherwise you can use google webmaster tools to find all the backlinks.
0
 
Big MontySenior Web Developer / CEO of ExchangeTree.org Commented:
i agree with padas, except I would do it at the IIS level so that you don't have to edit each page. For IIS7+, you can use the built in URL Rewriter module, otherwise there are free third party tools you can use:

IIS7 and above - http://www.iis.net/downloads/microsoft/url-rewrite

IIS 6 and below - http://www.isapirewrite.com
0
 
bsharathAuthor Commented:
Site is a Drupal/Mysql
Dynamic pages
0
What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

 
Tony McCreathTechnical SEO ConsultantCommented:
Google Webmaster Tools is your most direct source of missing pages that Google has detected.

Another method is to find all the backlinks to your website (e.g. Majestic SEO) and test them all to see if they are broken (e.g. Screaming Frog).
0
 
Big MontySenior Web Developer / CEO of ExchangeTree.org Commented:
if you're using apache as your web server, you can accomplish url rewriting with mod_rewrite:

http://httpd.apache.org/docs/2.0/mod/mod_rewrite.html
0
 
oliverpoldenCommented:
Ok you really want to use Global Redirect module for this. I would also recommend the search404 module which you can configure to either perform a search with the url parameters when a 404 page is hit, or redirect to the best match: http://drupal.org/project/search404

You can use the Global Redirect module to set up your redirects but also if you change a URL in the future, you can configure Global Redirect to automatically create a 301 redirect to the new alias: http://drupal.org/project/globalredirect

Lastly, if you are using Linux then there is the linkchecker package:
sudo apt-get install linkchecker
linkchecker -r2 --ignore-url=^mailto: --no-warnings www.yoursite.com

The -r2 is the link level to go down to, You might want to set it to -r3 or higher if there are more clicks to get to your deleted pages, although these will obviously only appear if there are links to your deleted pages.

If you're not using Linux, then you can use Xenu:
http://home.snafu.de/tilman/xenulink.html#Download

Really, the only way to do this, to find the broken URLs in Google is to use Google Webmaster tools. You will find the URLs under Crawl errors.
0
 
fiboCommented:
Drupal's admin allows you to record which missing pages were asked for... butr yes, this is just half of the problem..
0
 
fiboCommented:
B-) Glad we could help. Thx for the grade and points!
0

Featured Post

Eye-catchers on the conference table

Challenge: The i-unit group was not satisfied with the audio quality during remote meetings. They were looking for a portable solution with excellent audio quality for use in their conference room but also at their client’s offices.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now