Solved

how to gather data from news site

Posted on 2014-12-25
6
22 Views
Last Modified: 2016-05-13
Hi
I wish to gather data from reputed news site as it reports all over the world.
I wish to know how to capture this information into which database(as data will be huge) , do analysis on it and produce reports,charts as required.
I request to provide information about the concepts and tools which need to be used to develop a software which does this functionality
0
Comment
Question by:dsspl
6 Comments
 
LVL 84

Expert Comment

by:ozo
ID: 40518453
What sort of data, from which sites?
0
 
LVL 53

Accepted Solution

by:
COBOLdinosaur earned 500 total points
ID: 40520532
Generally sites willing to share news content have RSS feeds.  If they are not willing to share content then taking it without permission will likely violates copyright. If they charge subscribers fees then it is definitely copyright infringement and depending on the jurisdiction could result in lawsuits or criminal charges.

If they view you as more of a nuisance they will just block your access.

As for all the database, analysis, and reporting stuff; I would point out that this is a Q/A site and if you want a full project like that then you will need to do formal requirements and put out an RFP to get quotes from company who take on such projects.

Cd&
0
 
LVL 5

Expert Comment

by:Hello World
ID: 40521459
you can use private network to handle the relationship of each site.
All significant information will auto-replicate in AD, more details about AD:
http://msdn.microsoft.com/en-us/library/aa746492(v=vs.85).aspx
0
 
LVL 32

Expert Comment

by:Kamran Arshad
ID: 40588031
Hi,

Using RSS Feeds you can use the below analyzer;

http://market-news-analyzer.software.informer.com/
0

Featured Post

Threat Intelligence Starter Resources

Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

Join & Write a Comment

If I have to fix slow responding website my first thoughts are server side optimizations: the database may not be optimized or caching is not enabled, or things like that. We often overlook another major part of our web application: the client. We o…
Thoughout my experience working on eCommerce web applications I have seen applications succumbing to increased user demand and throughput. With increased loads the response times started to spike, which leads to user frustration and lost sales. I ha…
The purpose of this video is to demonstrate how to set up an RSS Feed on a WordPress Website. This will be demonstrated using a Windows 8 PC. Feedburner will be used for this demonstration. Go to your WordPress login page. This will look like the…
Use Wufoo, an online form creation tool, to make powerful forms. Learn how to selectively show certain fields based on user input using rules to gather relevant information and data from your forms. The rules feature provides you with an opportunity…

746 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now