Solved

Is scraping a website allowed?

Posted on 2010-08-22
6
538 Views
Last Modified: 2013-12-14
Is it okay to scrape a website for data?

It seems to me that if the data is publically available and even the source code for the page is visible through the View Source option, that scraping the website is also allowed.  But I need to hear what others think about this first.

What could the website do to block scraping?  Legally?  Technically?  

Would they need to block so that View Source fails?  Is that even possible?

I'm curious...

Thanks,
newbieweb

0
Comment
Question by:newbieweb
  • 2
  • 2
  • 2
6 Comments
 
LVL 11

Accepted Solution

by:
mattibutt earned 250 total points
Comment Utility
even if you scrap the website google cache the website and its available if is no longer coming from you. blocking view-source is not possible with html.
if you are using java applet or flash then it will not be visible there are some other applications. there are techniques to disable browser saving file locally but then you are suppose to program  this for every single browser exists.
the source of website if written in server side will never be visible on the browser for instance if you used java servlet, php, .net or ruby nothing will ever be avilable publicy unless someone hacks into the webserver i am still confuse what are you trying to acheive
0
 
LVL 2

Assisted Solution

by:ghemstrom
ghemstrom earned 250 total points
Comment Utility
The webpage with its supporting data is protected by the publisher's copyright, which implies that you could read it but not republish it without the publishers consent. Even the linking to his page should not be done without consent if it is not evident that it is allowed...
0
 

Author Comment

by:newbieweb
Comment Utility
I am not trying to block my website from scraping, I am trying to find if it's allowed for me to scrape other websites.  Websites exist with data I want to import.

I wonder if that is allowed, and if it's possible just by reading the HTML.
0
What Is Threat Intelligence?

Threat intelligence is often discussed, but rarely understood. Starting with a precise definition, along with clear business goals, is essential.

 
LVL 11

Assisted Solution

by:mattibutt
mattibutt earned 250 total points
Comment Utility
you need author permission perior to using their content if they have forbidden the use of their content if not you can use it
0
 
LVL 2

Assisted Solution

by:ghemstrom
ghemstrom earned 250 total points
Comment Utility
I would say that you must have a permission if the permission is not explicitely given on the webpage.
0
 

Author Closing Comment

by:newbieweb
Comment Utility
Thanks.
0

Featured Post

Easy Project Management (No User Manual Required)

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Communication between departments might not happen in two different languages, but they do exist in two different worlds. With different targets and performance goals the same phrase often means something completely different to each party. Learn ho…
"Disruption" is the most feared word for C-level executives these days. They agonize over their industry being disturbed by another player - most likely by startups.
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

772 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now