Forum Post Grabber/organizer

Hello experts,

I am looking for a good solution (software) that will help me archive questions and replies from certain forums (or RSS feed) and put them into my database structure for offline viewing and search.

It must be easy with RSS but I am not sure if the forums are using a global format which will allow a software to grab information in them.

Please give me recommendations if such software exists?

Thanks

[No RSS readers please, I used a few of them but they are not what I am looking for]
bozerAsked:
Who is Participating?

[Webinar] Streamline your web hosting managementRegister Today

x
 
Jason C. LevineConnect With a Mentor No oneCommented:
I see.

I'm not sure what you are asking for exists as commercial software.  There are too many variables from site to site to have one product fit all.

In this situation, you are looking at writing a scraper script that is aimed at a specific site.  Once you limit yourself to a single site, you can analyze the page structure and determine the HTML containers.  From there, a simple regular expression extracts what you want.
0
 
Jason C. LevineNo oneCommented:
Hi bozer,

There are a wide variety of spidering programs out there if you Google for them...
0
 
bozerAuthor Commented:
Hi Jason,

I did several times but maybe I am not using the correct words. I always get lots of RSS Readers but nothing about forum entries reader or exporter into DB

Thanks
0
Learn to develop an Android App

Want to increase your earning potential in 2018? Pad your resume with app building experience. Learn how with this hands-on course.

 
Jason C. LevineNo oneCommented:
Try searching for "offline website downloader" instead.   That should produce a ton of usable results.

Just make sure you run this on sites that permit it.   Sometimes copying the contents offline is prohibited by the Terms of Service.
0
 
bozerAuthor Commented:
But it's not what I want,

I need a software that will parse the questions and replies and put them into a database.

An offline website download will not do that.
0
 
bozerAuthor Commented:
Hello,

I was hoping there are already prepared applications for popular Forum platforms like Invision, etc.

I guess there is not any?
0
 
Jason C. LevineConnect With a Mentor No oneCommented:
Not really, since what you are asking for goes against the reason for people to put up a board in the first place, namely to get folks on the site.
0
 
Jason C. LevineNo oneCommented:
My last two posts provide a long-winded version of "what you want doesn't exist" and should be saved as a solution for future readers.  I'm willing to not accept any points for the solution since I do agree that it isn't very helpful to the original asker.

0
All Courses

From novice to tech pro — start learning today.