Solved

Wordpress auto blog using RSS feed to pull ecommerce items

Posted on 2014-07-28
3
348 Views
Last Modified: 2014-08-21
I am in the process of building an auto blog using wordpress. I see there is a plugin that generates blogs via RSS feed. I was using this as the big idea to generate blogs on my sites. However, I just ran in to a snag.

I fell in love with the WPeMatico plugin for auto blogs. However, I just realized this uses RSS feeds. That I know off, RSS feeds only scrapes blogs from other sites.

I want to scrape specific items that other sites have for sale but then pull them into my site as a “blog” As I said before in another thread – like werd.com but in an “auto fashion” is this feasible?
0
Comment
Question by:tobe1424
  • 2
3 Comments
 
LVL 108

Assisted Solution

by:Ray Paseur
Ray Paseur earned 500 total points
ID: 40225551
Is it feasible?  Probably at some level.  You may run afoul of the terms of use of other sites if you're scraping their content without their permission.

Is it easy to do?  Usually, yes.  However it's not a question with an "answer," it's a requirement for application development and for that you should hire a professional developer that you can share the details with.
0
 

Author Comment

by:tobe1424
ID: 40225779
Thanks for the input.

Before I start scraping their content I would initiate contact and explain to them what I am trying to accomplish.

As for the application development, i see where I might need to hire a consultant as RSS feeds only scrape blogs and not actual items for sale on other sites.

For the record, there isn't a plugin that scrapes other sites ecommerce items?

Like a werd.com but in an autoblog format where I don't have to manually add all the post?

Or will i need to hire a web admin or stick with the guns (application development) ?

thx again
0
 
LVL 108

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 40227339
Usually if a web publisher or store wants you to have access to their data, they will expose an API.  You should ask about this before you embark on a scraping effort.  The API will probably be stable, version controlled, etc.  No such stability exists for web sites which can be changed without notice.

An RSS feed is simply a specialized subset of XML.  It carries only a few bits of information, such as a title, description and link.  RSS is very ightweight and easy to use.  The publisher of an RSS feed adheres to the RSS standard.  You can consume an RSS feed in PHP with the SimpleXML object.

I am not aware of any plugin that scrapes ecommerce items from other sites.  In order to write one you would need to understand the markup of the other sites, and that is quite a research project.  More and more, ecommerce sites are not using HTML to load the documents.  Instead they load a stripped-down version of the markup and then use JavaScript to add data to the page.  This makes the "view source, copy code" process much more difficult.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Things That Drive Us Nuts Have you noticed the use of the reCaptcha feature at EE and other web sites?  It wants you to read and retype something that looks like this.Insanity!  It's not EE's fault - that's just the way reCaptcha works.  But it is …
This article shows how a content item can be identified directly or through translation of a navigation type. It then shows how this information can be used to create a menu for further navigation.
The purpose of this video is to demonstrate how to Import and export files in WordPress. This will be demonstrated using a Windows 8 PC. Go to your WordPress login page. This will look like the following: mywebsite.com/wp-login.php : Click on Too…
The purpose of this video is to demonstrate how to set up an RSS Feed on a WordPress Website. This will be demonstrated using a Windows 8 PC. Feedburner will be used for this demonstration. Go to your WordPress login page. This will look like the…

910 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

21 Experts available now in Live!

Get 1:1 Help Now