Challenge: S&ME was tired of poor audio quality of Skype for Business calls in mid-sized meeting and training rooms. They were looking for a reliable and cost efficient solution to replace the existing conferencing system.
Solved
Is their any way to find broken URL's?
Posted on 2013-01-03
Is their any way to find broken URL's?
We deleted 100's of URL's of our site and Google shows a lot of them still
I want a way to find out all such URL's that are still live in Google but actually deleted
Any script or tool to find this?
We deleted 100's of URL's of our site and Google shows a lot of them still
I want a way to find out all such URL's that are still live in Google but actually deleted
Any script or tool to find this?
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
2
2
- +3
8 Comments
Active today
Where the old urls built dynamically and not you are using some other way to dynamically build urls?
If that is the case, I would create vb script to watch for those patterns either on a page like
<%
theQuerystring=request.que
if some variable = x then
newQstring=z
end if
' Permanent redirection
Response.Status = "301 Moved Permanently"
Response.AddHeader "Location", "http://www.mysite.com/newpage.asp?q="&newQstring
Response.End
%>
Or use pattern matching in iis 301 redirect
Otherwise you can use google webmaster tools to find all the backlinks.
If that is the case, I would create vb script to watch for those patterns either on a page like
<%
theQuerystring=request.que
if some variable = x then
newQstring=z
end if
' Permanent redirection
Response.Status = "301 Moved Permanently"
Response.AddHeader "Location", "http://www.mysite.com/newpage.asp?q="&newQstring
Response.End
%>
Or use pattern matching in iis 301 redirect
Otherwise you can use google webmaster tools to find all the backlinks.
Active today
i agree with padas, except I would do it at the IIS level so that you don't have to edit each page. For IIS7+, you can use the built in URL Rewriter module, otherwise there are free third party tools you can use:
IIS7 and above - http://www.iis.net/downloads/microsoft/url-rewrite
IIS 6 and below - http://www.isapirewrite.com
IIS7 and above - http://www.iis.net/downloads/microsoft/url-rewrite
IIS 6 and below - http://www.isapirewrite.com
Google Webmaster Tools is your most direct source of missing pages that Google has detected.
Another method is to find all the backlinks to your website (e.g. Majestic SEO) and test them all to see if they are broken (e.g. Screaming Frog).
Another method is to find all the backlinks to your website (e.g. Majestic SEO) and test them all to see if they are broken (e.g. Screaming Frog).
Active today
if you're using apache as your web server, you can accomplish url rewriting with mod_rewrite:
http://httpd.apache.org/docs/2.0/mod/mod_rewrite.html
http://httpd.apache.org/docs/2.0/mod/mod_rewrite.html
Ok you really want to use Global Redirect module for this. I would also recommend the search404 module which you can configure to either perform a search with the url parameters when a 404 page is hit, or redirect to the best match: http://drupal.org/project/search404
You can use the Global Redirect module to set up your redirects but also if you change a URL in the future, you can configure Global Redirect to automatically create a 301 redirect to the new alias: http://drupal.org/project/globalredirect
Lastly, if you are using Linux then there is the linkchecker package:
sudo apt-get install linkchecker
linkchecker -r2 --ignore-url=^mailto: --no-warnings www.yoursite.com
The -r2 is the link level to go down to, You might want to set it to -r3 or higher if there are more clicks to get to your deleted pages, although these will obviously only appear if there are links to your deleted pages.
If you're not using Linux, then you can use Xenu:
http://home.snafu.de/tilman/xenulink.html#Download
Really, the only way to do this, to find the broken URLs in Google is to use Google Webmaster tools. You will find the URLs under Crawl errors.
You can use the Global Redirect module to set up your redirects but also if you change a URL in the future, you can configure Global Redirect to automatically create a 301 redirect to the new alias: http://drupal.org/project/globalredirect
Lastly, if you are using Linux then there is the linkchecker package:
sudo apt-get install linkchecker
linkchecker -r2 --ignore-url=^mailto: --no-warnings www.yoursite.com
The -r2 is the link level to go down to, You might want to set it to -r3 or higher if there are more clicks to get to your deleted pages, although these will obviously only appear if there are links to your deleted pages.
If you're not using Linux, then you can use Xenu:
http://home.snafu.de/tilman/xenulink.html#Download
Really, the only way to do this, to find the broken URLs in Google is to use Google Webmaster tools. You will find the URLs under Crawl errors.
Drupal's admin allows you to record which missing pages were asked for... butr yes, this is just half of the problem..
Featured Post
Want to avoid the missteps to gaining all the benefits of the cloud? Learn more about the different assessment options from our Cloud Advisory team.
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
SEO can be a real minefield to navigate, but there are three simple ways to up your SEO game just be re-assessing your content output.
Read on to get a few ideas on how to promote your next corporate event.
This tutorial demonstrates how to identify and create boundary or building outlines in Google Maps. In this example, I outline the boundaries of an enclosed skatepark within a community park.
Login to your Google Account, then Google for "Google M…
Use Wufoo, an online form creation tool, to make powerful forms. Learn how to selectively show certain fields based on user input using rules to gather relevant information and data from your forms. The rules feature provides you with an opportunity…
Suggested Courses
Course of the Month4 days, 10 hours left to enroll
661 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.