Is there a legal way to scrape data from a site?

Posted on 2007-07-25
Medium Priority
Last Modified: 2013-11-15
I work with a construction company that is doing some statistical analysis of future areas they looking to build and we need to collect information that appraisal district office has freely available to the public online just not in the bulk quantity we need.. They don't explicitly say that data cannot be scraped from their site but just to be safe is there a way to acquire that data legally or is it just a grey area?
Question by:Bluelude1
  • 2

Expert Comment

ID: 19570422
Grabbing mass data from any site that doesn't say that it's allowed could have legality issues. Remember that webserver log data access. Try calling, emailing, or even snailmailing (writing) to the appraisal district office.  They are probably more than willing to help out if the data is free as you suspect.


Author Comment

ID: 19570508
i have called and asked but the response is that they don't have bulk data available and that i would have to go through there site and search one street at a time. Hence my current position

Accepted Solution

LocoTechCJ earned 1500 total points
ID: 19570539
Gotcha.  Without knowledge of their database or data structure, there's not an easy way.

Featured Post

Visualize your virtual and backup environments

Create well-organized and polished visualizations of your virtual and backup environments when planning VMware vSphere, Microsoft Hyper-V or Veeam deployments. It helps you to gain better visibility and valuable business insights.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Instead of error trapping or hard-coding for non-updateable fields when using QODBC, let VBA automatically disable them when forms open. This way, users can view but not change the data. Part 1 explained how to use schema tables to do this. Part 2 h…
Over time, the online landscape has altered considerably, but that’s nothing compared to the up-and-coming trends that will shape the web design industry in the coming year. Keep reading to find out which trends will shape B2B web design in 2018.
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.
Learn how to set-up PayPal payment integration in your Wufoo form. Allow your users to remit payment through PayPal upon completion of your online form. This is helpful for collecting membership payments, customer payments, donations, and more.
Suggested Courses

807 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question