Solved

Finding Wierd URL

Posted on 2011-03-01
2
207 Views
Last Modified: 2013-11-19
I'm finding some very weird urls for my site when I I do google searches.  I do not know how these urls are being created and I need a way to try and spider my site and see every possible link that my site might have.  Does anybody have any suggestions on how to do this?
0
Comment
Question by:cstormer
2 Comments
 
LVL 83

Accepted Solution

by:
Dave Baldwin earned 250 total points
ID: 35014620
Have you created a sitemap yet?  I use GsiteCrawler http://gsitecrawler.com/ to create mine.  It will locate all the public pages that you have linked in your site.
0
 
LVL 17

Assisted Solution

by:selvol
selvol earned 250 total points
ID: 35014809
Use Offline explorer Pro.

It has a free 30 day trial.
After installing,
open
Create new project.
Put your URL in the box.
See picture 1 & 2

Then DOWNLOAD

This will save your whole site if correctly linked.
Then you can browse the site, view the map and more from with in Offline Explorer.

Selvol Offline exploreroe2.gif
0

Featured Post

Master Your Team's Linux and Cloud Stack!

The average business loses $13.5M per year to ineffective training (per 1,000 employees). Keep ahead of the competition and combine in-person quality with online cost and flexibility by training with Linux Academy.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article will inform Clients about common and important expectations from the freelancers (Experts) who are looking at your Gig.
Preparing an email is something we should all take special care with – especially when the email is for somebody you may not know very well. The pressures of everyday working life stacked with a hectic office environment can make this a real challen…
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
Learn how to create flexible layouts using relative units in CSS.  New relative units added in CSS3 include vw(viewports width), vh(viewports height), vmin(minimum of viewports height and width), and vmax (maximum of viewports height and width).

856 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question