Solved

How to  clean this feed?

Posted on 2010-09-16
14
2,215 Views
Last Modified: 2013-11-18
Hi,

At www.groenerekenkamer.nl/milieublogs I run a page with the feeds of several blogs. As you can see both the 'GreenieWatch' feed and the 'FoodHealthSkeptic'-feed contain leftover tags. Since other feeds do not have this I assume it is the feeds fault. I would like to contact te producer, but I do not have the idea that he would know a solution. Do you?
0
Comment
Question by:TheoRichel
  • 5
  • 3
  • 3
  • +2
14 Comments
 

Expert Comment

by:iliyas_patel
ID: 33689616
Use a proper standard instruction and make sure at the time of running your previous data/record should be clear
0
 

Expert Comment

by:iliyas_patel
ID: 33689623
great
0
 

Expert Comment

by:iliyas86
ID: 33689666
thanks
0
 
LVL 108

Expert Comment

by:Ray Paseur
ID: 33690032
Please see the code snippet.  You will see things with strings like & l t ;  b r  & g t ;

These are "entitized" HTML tags, and that is usually the right way to put tags into an XML string like an RSS feed.  If you want to scrub this out of the feed, I will be glad to show you how.  Please post a link to the source of the data and I can show you a simple PHP script that will clean it up.  Hopefully you can integrate that in to Drupal.
<div class="block block-aggregator" id="block-aggregator-feed-6">

          <h2 class="title">Food and Health Skeptic</h2>

        <div class="content"><div class="item-list"><ul><li class="first"><a href="http://john-ray.blogspot.com/2010/09/autism-drug-has-some-promise-this-is.html">&lt;br&gt;&lt;br /&gt;&lt;b&gt;Autism  drug has some</a>

</li>



<li><a href="http://john-ray.blogspot.com/2010/09/anti-mcdonalds-ad-angers-fast-food.html">&lt;br&gt;&lt;br /&gt;&lt;b&gt;Anti-McDonald&#039;s ad angers</a>

</li>

<li><a href="http://john-ray.blogspot.com/2010/09/study-finds-people-with-lots-of-friends.html">&lt;br&gt;&lt;br /&gt;&lt;b&gt;Study finds people with</a>

</li>

<li><a href="http://john-ray.blogspot.com/2010/09/wcrf-is-at-it-again-extra-inch-on-waist.html">&lt;br&gt;&lt;br /&gt;&lt;b&gt;The WCRF is at it again: </a>



</li>

<li class="last"><a href="http://john-ray.blogspot.com/2010/09/cancer-patients-from-wealthy-areas-of.html">&lt;br&gt;&lt;br /&gt;&lt;b&gt;Cancer patients from</a>

</li>

</ul></div><div class="more-link"><a href="/aggregator/sources/6" title="Het meest recente nieuws van deze feed bekijken.">more</a></div></div>

 </div>

Open in new window

0
 

Author Comment

by:TheoRichel
ID: 33690572
Sounds promising Ray, thanks,
The datasource is: http://john-ray.blogspot.com/feeds/posts/default?alt=rss

Though I have no idea where to integrate that in Drupal.
0
 

Author Comment

by:TheoRichel
ID: 33690662
Fyi: on the page on my site that i point you to only shows blocks of the feed. If I go the the page of that feed (on my site) I see that the text is interspersed with 'No title provided'.
0
 
LVL 108

Expert Comment

by:Ray Paseur
ID: 33691989
Interesting.  You may want to try processing the feed though this before using it in your site.  Give it a try and let's see if we have made any progress.
<?php // RAY_temp_theorichel.php

error_reporting(E_ALL);



// TEST DATA - READ AND MAKE AN OBJECT

$url = 'http://john-ray.blogspot.com/feeds/posts/default?alt=rss';

$xml = file_get_contents($url);

$obj = SimpleXML_Load_String($xml);



// ITERATE OVER THE OBJECT TO CLEAN UP THE EMBEDDED HTML IN THE DESCRIPTION FIELDS

foreach ($obj->channel->item as $item)

{

    $desc = $item->description;

    $desc = str_replace('<br>',   ' ', $desc);

    $desc = str_replace('<br />', ' ', $desc);

    $desc = strip_tags($desc, '<b>');

    $desc = str_replace('</b>', '</b> ', $desc);

    $item->description = $desc;

}



// ACTIVATE THIS TO SEE THE NEW OBJECT

// var_dump($obj);



// PRODUCE CLEANED UP XML

echo $obj->AsXML();

Open in new window

0
What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

 
LVL 17

Expert Comment

by:Thomas4019
ID: 33692215
You should be able to fix this by configuring Drupal's Input Format settings for the input format used by that node type. There is an option to remove by tags or to entityize them. You simply need to switch it.
0
 
LVL 108

Expert Comment

by:Ray Paseur
ID: 33692259
It looks like the current setting is "entitize"

;-)
0
 
LVL 17

Accepted Solution

by:
Thomas4019 earned 500 total points
ID: 33693104
Yeah!, here's some guides to familiarize yourself with Input Formats, if you don't know how to fix it.

http://www.lullabot.com/articles/drupal-input-formats-and-filters
http://drupal.org/node/213156
0
 

Author Comment

by:TheoRichel
ID: 33693179
Gentlemen thank you both, but the feed of the Drupal core aggregator does not produce 'nodes', but something called  a 'source'.
And as to the script: thanks veru much, but I wouldnt know where to paste that. Anyone else does?
0
 
LVL 17

Expert Comment

by:Thomas4019
ID: 33693213
So are you building that page with just the core aggregator module? I have not used that module much but thought it was just for producing RSS feeds, etc. Are you using any contributed modules to make that page like Views, Services, etc?
0
 

Author Comment

by:TheoRichel
ID: 33699549
@Thomas: Yes indeed, the core module, it works alright, though it has problems with Atom feeds. I added a patch, but that didnt improve anything,. The original url was: http://john-ray.blogspot.com/feeds/posts/default but it only works now since I added '?alt=rss', and then shows the tags.

BTW: I just discovered that the aggregator does have a setting to strip tags (yes I should have seen that before,  my bad), but it has no effect.
0
 

Author Closing Comment

by:TheoRichel
ID: 37924494
This made clear that with the present software I would never be able to solve my problem. Switching to Feeds did.
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

Preface In the first article: A Better Website Login System (http://www.experts-exchange.com/A_2902.html) I introduced the EE Collaborative Login System and its intended purpose. In this article I will discuss some of the design consideratio…
Introduction Knockoutjs (Knockout) is a JavaScript framework (Model View ViewModel or MVVM framework).   The main ideology behind Knockout is to control from JavaScript how a page looks whilst creating an engaging user experience in the least …
The viewer will learn how to dynamically set the form action using jQuery.
The viewer will learn the basics of jQuery, including how to invoke it on a web page. Reference your jQuery libraries: (CODE) Include your new external js/jQuery file: (CODE) Write your first lines of code to setup your site for jQuery.: (CODE)

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now