Solved

Finding Wierd URL

Posted on 2011-03-01
2
205 Views
Last Modified: 2013-11-19
I'm finding some very weird urls for my site when I I do google searches.  I do not know how these urls are being created and I need a way to try and spider my site and see every possible link that my site might have.  Does anybody have any suggestions on how to do this?
0
Comment
Question by:cstormer
2 Comments
 
LVL 83

Accepted Solution

by:
Dave Baldwin earned 250 total points
ID: 35014620
Have you created a sitemap yet?  I use GsiteCrawler http://gsitecrawler.com/ to create mine.  It will locate all the public pages that you have linked in your site.
0
 
LVL 17

Assisted Solution

by:selvol
selvol earned 250 total points
ID: 35014809
Use Offline explorer Pro.

It has a free 30 day trial.
After installing,
open
Create new project.
Put your URL in the box.
See picture 1 & 2

Then DOWNLOAD

This will save your whole site if correctly linked.
Then you can browse the site, view the map and more from with in Offline Explorer.

Selvol Offline exploreroe2.gif
0

Featured Post

DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Wrapper for APPs 9 40
Standard for Web Development 3 28
bootstrap footer centering and columns alignement 3 26
Not seen Link button 5 19
I've been asked to discuss some of the UX activities that I'm using with my team. Here I will share some details about how we approach UX projects.
Get to know the ins and outs of building a web-based ERP system for your enterprise. Development timeline, technology, and costs outlined.
Learn how to create flexible layouts using relative units in CSS.  New relative units added in CSS3 include vw(viewports width), vh(viewports height), vmin(minimum of viewports height and width), and vmax (maximum of viewports height and width).
The is a quite short video tutorial. In this video, I'm going to show you how to create self-host WordPress blog with free hosting service.

863 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now