Solved

how to gather data from news site

Posted on 2014-12-25
6
59 Views
Last Modified: 2016-05-13
Hi
I wish to gather data from reputed news site as it reports all over the world.
I wish to know how to capture this information into which database(as data will be huge) , do analysis on it and produce reports,charts as required.
I request to provide information about the concepts and tools which need to be used to develop a software which does this functionality
0
Comment
Question by:dsspl
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
6 Comments
 
LVL 84

Expert Comment

by:ozo
ID: 40518453
What sort of data, from which sites?
0
 
LVL 53

Accepted Solution

by:
COBOLdinosaur earned 500 total points
ID: 40520532
Generally sites willing to share news content have RSS feeds.  If they are not willing to share content then taking it without permission will likely violates copyright. If they charge subscribers fees then it is definitely copyright infringement and depending on the jurisdiction could result in lawsuits or criminal charges.

If they view you as more of a nuisance they will just block your access.

As for all the database, analysis, and reporting stuff; I would point out that this is a Q/A site and if you want a full project like that then you will need to do formal requirements and put out an RFP to get quotes from company who take on such projects.

Cd&
0
 
LVL 5

Expert Comment

by:Hello World
ID: 40521459
you can use private network to handle the relationship of each site.
All significant information will auto-replicate in AD, more details about AD:
http://msdn.microsoft.com/en-us/library/aa746492(v=vs.85).aspx
0
 
LVL 32

Expert Comment

by:Kamran Arshad
ID: 40588031
Hi,

Using RSS Feeds you can use the below analyzer;

http://market-news-analyzer.software.informer.com/
0

Featured Post

SharePoint Admin?

Enable Your Employees To Focus On The Core With Intuitive Onscreen Guidance That is With You At The Moment of Need.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
algorithm 15 145
Math Question 1 149
How to write an English digest paper 6 151
Azure Web App - HTTP Redirect - web.config file help 23 61
Introduction Many of the most common information processing tasks require sorting data sets.  For example, you may want to find the largest or smallest value in a collection.  Or you may want to order the data set in numeric or alphabetical order. …
Exception Handling is in the core of any application that is able to dignify its name. In this article, I'll guide you through the process of writing a DRY (Don't Repeat Yourself) Exception Handling mechanism, using Aspect Oriented Programming.
The purpose of this video is to demonstrate how to Test the speed of a WordPress Website. Site Speed is an important metric of a site’s health. Slow site speed can result in viewers leaving your site quickly and not seeing your content. This…
The purpose of this video is to demonstrate how to Import and export files in WordPress. This will be demonstrated using a Windows 8 PC. Go to your WordPress login page. This will look like the following: mywebsite.com/wp-login.php : Click on Too…

752 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question