<div>
<br />
<br />
You can read on wkipedia about both:<br />
<a href="http://en.wikipedia.org/wiki/Web_crawler" rel="ugc">http://en.wikipedia.org/wiki/Web_crawler</a><br />
<br />
<a href="http://en.wikipedia.org/wiki/Mirror_%28computing%29" rel="ugc">http://en.wikipedia.org/wiki/Mirror_%28computing%29</a>
</div>




You can read on wkipedia about both:
http://en.wikipedia.org/wiki/Web_crawler [http://en.wikipedia.org/wiki/Web_crawler]

http://en.wikipedia.org/wiki/Mirror_%28computing%29 [http://en.wikipedia.org/wiki/Mirror_%28computing%29]

<div>
<div class="content wysiwyg-content">
I am thinking they are same thing but <br />
I am trying to write up a crawler that will download everything from the given URL.<br />
The web crawler only looks for the hyperlinked &lt;a&gt; tag, is that correct?<br />
What if the web folder/subfolders which are not linked on the URL?<br />
Hoes it find those?<br />
I guess I don't understand what crawler exactly does.<br />
Can you explain this?<br />

</div>
</div>


I am thinking they are same thing but 
I am trying to write up a crawler that will download everything from the given URL.
The web crawler only looks for the hyperlinked <a> tag, is that correct?
What if the web folder/subfolders which are not linked on the URL?
Hoes it find those?
I guess I don't understand what crawler exactly does.
Can you explain this?


web crawler vs mirroring web site?

File sharing is the practice of distributing or providing access to digital media, such as computer programs, multimedia (audio, images and video), documents or electronic books. Common methods of storage, transmission and dispersion include manual sharing utilizing removable media, centralized servers on computer networks, World Wide Web-based hyperlinked documents, distributed peer-to-peer networking (P2P) and cloud-based file syncing.

File Sharing Software

Java is a platform-independent, object-oriented programming language and run-time environment, designed to have as few implementation dependencies as possible such that developers can write one set of code across all platforms using libraries. Most devices will not run Java natively, and require a run-time component to be installed in order to execute a Java program.

Java

The successor to Active Server Pages, ASP.NET websites utilize the .NET framework to produce dynamic, data and content-driven web applications and services. ASP.NET code can be written using any .NET supported language. As of 2009, ASP.NET can also apply the Model-View-Controller (MVC) pattern to web applications