Solved

Parse syndication feed using jdom

Posted on 2011-03-24
5
493 Views
Last Modified: 2013-11-18
Hello,

Hello I have to parse a online feed using syndication and jdom. All I would need is to get the
epi:category element where I am unable using just syndication API.. Please help

Below is the java program I have used.
import java.io.File;
import java.net.HttpURLConnection;
import java.net.URL;
import java.util.Iterator;
import java.util.List;

import com.sun.syndication.feed.synd.SyndContent;
import com.sun.syndication.feed.synd.SyndEntryImpl;
import com.sun.syndication.feed.synd.SyndEntry;
import com.sun.syndication.feed.synd.SyndFeed;
import com.sun.syndication.io.SyndFeedInput;
import com.sun.syndication.io.SyndFeedOutput;
import com.sun.syndication.io.XmlReader;

import org.jdom.input.SAXBuilder;
import org.jdom.output.XMLOutputter;
import org.jdom.xpath.XPath;
import org.jdom.*;

public class CheckFeed {

      public static void main(String[] args) {
            try {
                  //URL feedUrl = new URL("https://gmail.google.com/gmail/feed/atom");
                  URL feedUrl  = new URL("https://api.entertainment.com/AtomServer3/feeds/category?location=48084");

                  HttpURLConnection httpcon = (HttpURLConnection)feedUrl.openConnection();
                  String encoding = new sun.misc.BASE64Encoder().encode("demo:demo".getBytes());
                  httpcon.setRequestProperty ("Authorization", "Basic " + encoding);
                  SyndFeedInput input = new SyndFeedInput();
                  SyndFeed feed = input.build(new XmlReader(httpcon));
                  //String value = ((SyndEntry) feed.getEntries().get(0)).getDescription().getValue();
                  //SyndFeed feed = input.build(new XmlReader(feedUrl));

                  //System.out.println("Feed:value " + value);
                  System.out.println("Title: " + feed.getTitle());
                  System.out.println("Feed Author: "+ feed.getAuthors());
                  
                  
                  SyndFeedOutput outputjdom = new SyndFeedOutput();
                  // will output feed as jdom
                  Document doc = outputjdom.outputJDom(feed);
                  //SAXBuilder builder = new SAXBuilder();
                  //Document doc = builder.build((File) feed);
                  XPath x      = XPath.newInstance("/feed/entry");
                  List list    = x.selectNodes(doc);
                  Iterator it2 = list.iterator();
                  while (it2.hasNext()) {
                        System.out.println("Content:"+it2.toString());
                  }
                  //listElements(list, "");
                  //doc.toString() is part of jdom should output the document to console            
                  System.out.println("Document::"+doc.toString());                  

                  Element root = doc.getRootElement();
                  System.out.println("content size is "+root.getContentSize());                  
                  
                  
                  //List entries = feed.getEntries();
                  //System.out.println("Total Entries : " + entries.size());
            } catch (Exception ex) {
                  ex.printStackTrace();
                  System.out.println("ERROR: " + ex.getMessage());
            }
      }

}

Below is the feed XML if I access through browser manually
<?xml version="1.0" encoding="UTF-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:epi_ps="https://api.entertainment.com/AtomServer3/doc/index.html#psReference" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" xmlns:opensearch="http://a9.com/-/spec/opensearch/1.1/" xmlns:epi="https://api.entertainment.com/AtomServer3/doc/index.html#epiReference" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:gml="http://www.opengis.net/gml" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#">
  <author>
    <name>EPI</name>
  </author>
  <id>1300804687145</id>
  <entry>
    <title>Categories</title>
    <id>1300804687145</id>
    <updated>2011-03-22T14:38:07Z</updated>
    <epi:category id="160" name="RedemptionMethod" value="Online Discounts" records="18" />
    <epi:category id="159" name="RedemptionMethod" value="Printable Discounts" records="2644" />
    <epi:category id="161" name="AlphabetIndex" value="0-9" records="0" />
    <epi:category id="131" name="AlphabetIndex" value="A" records="0" />
    <epi:category id="132" name="AlphabetIndex" value="B" records="0" />
    <epi:category id="133" name="AlphabetIndex" value="C" records="0" />
    <epi:category id="134" name="AlphabetIndex" value="D" records="0" />
    <epi:category id="135" name="AlphabetIndex" value="E" records="0" />
    <epi:category id="136" name="AlphabetIndex" value="F" records="0" />
    <epi:category id="137" name="AlphabetIndex" value="G" records="0" />
    <epi:category id="138" name="AlphabetIndex" value="H" records="0" />
    <epi:category id="139" name="AlphabetIndex" value="I" records="0" />
    <epi:category id="140" name="AlphabetIndex" value="J" records="0" />
    <epi:category id="141" name="AlphabetIndex" value="K" records="0" />
    <epi:category id="142" name="AlphabetIndex" value="L" records="0" />
    <epi:category id="143" name="AlphabetIndex" value="M" records="0" />
    <epi:category id="144" name="AlphabetIndex" value="N" records="0" />
    <epi:category id="145" name="AlphabetIndex" value="O" records="0" />
    <epi:category id="146" name="AlphabetIndex" value="P" records="0" />
    <epi:category id="147" name="AlphabetIndex" value="Q" records="0" />
    <epi:category id="148" name="AlphabetIndex" value="R" records="0" />
    <epi:category id="149" name="AlphabetIndex" value="S" records="0" />
    <epi:category id="150" name="AlphabetIndex" value="T" records="0" />
    <epi:category id="151" name="AlphabetIndex" value="U" records="0" />
    <epi:category id="152" name="AlphabetIndex" value="V" records="0" />
    <epi:category id="153" name="AlphabetIndex" value="W" records="0" />
    <epi:category id="154" name="AlphabetIndex" value="X" records="0" />
    <epi:category id="155" name="AlphabetIndex" value="Y" records="0" />
    <epi:category id="156" name="AlphabetIndex" value="Z" records="0" />
    <epi:category id="25" name="Category" value="Dining" records="1629" />
    <epi:category id="26" name="Category" value="Events &amp; Attractions" records="287" />
    <epi:category id="27" name="Category" value="Shopping" records="704" />
    <epi:category id="91" name="Category" value="Travel" records="42" />
    <epi:category id="80" name="SubCategory" value="Informal &amp; Carryout" records="981" />
    <epi:category id="39" name="SubCategory" value="Casual Dining" records="565" />
    <epi:category id="42" name="SubCategory" value="Fine Dining" records="83" />
    <epi:category id="56" name="SubCategory" value="Attractions" records="16" />
    <epi:category id="65" name="SubCategory" value="Automotive" records="141" />
    <epi:category id="58" name="SubCategory" value="Bowling" records="53" />
    <epi:category id="84" name="SubCategory" value="Car Rental" records="18" />
    <epi:category id="32" name="SubCategory" value="Dry Cleaning" records="33" />
    <epi:category id="45" name="SubCategory" value="Golf" records="51" />
    <epi:category id="40" name="SubCategory" value="Grocery" records="11" />
    <epi:category id="81" name="SubCategory" value="Health &amp; Beauty" records="50" />
    <epi:category id="82" name="SubCategory" value="Home &amp; Garden" records="291" />
    <epi:category id="86" name="SubCategory" value="Hotel" records="24" />
    <epi:category id="64" name="SubCategory" value="Live Events" records="17" />
    <epi:category id="49" name="SubCategory" value="Museums" records="11" />
    <epi:category id="73" name="SubCategory" value="Music/Books/Video" records="5" />
    <epi:category id="62" name="SubCategory" value="Retail" records="156" />
    <epi:category id="90" name="SubCategory" value="Special Events" records="9" />
    <epi:category id="63" name="SubCategory" value="Sporting Events" records="34" />
    <epi:category id="34" name="SubCategory" value="Miscellaneous" records="94" />
    <epi:category id="471" name="SubCategory" value="Movies" records="11" />
    <epi:category id="485" name="SubCategory" value="Services" records="91" />
    <epi:category id="168" name="CuisineType" value="American" records="689" />
    <epi:category id="182" name="CuisineType" value="Asian" records="46" />
    <epi:category id="184" name="CuisineType" value="Cajun/Creole" records="4" />
    <epi:category id="185" name="CuisineType" value="Canadian" records="23" />
    <epi:category id="179" name="CuisineType" value="Coffee House" records="43" />
    <epi:category id="180" name="CuisineType" value="European" records="26" />
    <epi:category id="176" name="CuisineType" value="Indian" records="16" />
    <epi:category id="170" name="CuisineType" value="Italian" records="251" />
    <epi:category id="171" name="CuisineType" value="Mexican" records="45" />
    <epi:category id="178" name="CuisineType" value="Middle Eastern" records="20" />
    <epi:category id="469" name="OfferType" value="Frequent Value" records="597" />
    <epi:category id="470" name="OfferType" value="Premium" records="2064" />
  </entry>
</feed>
0
Comment
Question by:jexpert7
  • 3
  • 2
5 Comments
 
LVL 86

Expert Comment

by:CEHJ
ID: 35208263
Try
import org.jdom.*;

import org.jdom.input.SAXBuilder;

import org.jdom.output.XMLOutputter;

import org.jdom.xpath.XPath;

import java.io.File;

import java.net.HttpURLConnection;
import java.net.URL;

import java.util.Iterator;
import java.util.List;


public class CheckFeed {
    @SuppressWarnings("all")
	public static void main(String[] args) {
		try {
			URL feedUrl = new URL(
					"https://api.entertainment.com/AtomServer3/feeds/category?location=48084");

			HttpURLConnection httpcon = (HttpURLConnection) feedUrl.openConnection();
			String encoding = new sun.misc.BASE64Encoder().encode("demo:demo".getBytes());
			httpcon.setRequestProperty("Authorization", "Basic " + encoding);


			SAXBuilder builder = new SAXBuilder();
			Document doc = builder.build(httpcon.getInputStream());
			XPath x = XPath.newInstance("//epi:category");
			List list = x.selectNodes(doc);
			Iterator it2 = list.iterator();

			while (it2.hasNext()) {
				System.out.println("Content:" + it2.next().toString());
			}

			System.out.println("Document::" + doc.toString());

			Element root = doc.getRootElement();
			System.out.println("content size is " + root.getContentSize());

		} catch (Exception ex) {
			ex.printStackTrace();
			System.out.println("ERROR: " + ex.getMessage());
		}
	}
}

Open in new window

0
 

Author Comment

by:jexpert7
ID: 35209080
Thanks a lot CEHJ,

One last thing, this will be easy for you, I have to write a XPATH statement to get the count of "records" value for epi:category id="159" or id="160". what should it be?

    <epi:category id="160" name="RedemptionMethod" value="Online Discounts" records="18" />
    <epi:category id="159" name="RedemptionMethod" value="Printable Discounts" records="2644" />
0
 
LVL 86

Accepted Solution

by:
CEHJ earned 250 total points
ID: 35209272
You can do that thus:
XPath x = XPath.newInstance("//epi:category");
			List list = x.selectNodes(doc);
			Iterator it2 = list.iterator();

			while (it2.hasNext()) {
				//System.out.println("Content:" + it2.next().toString());
				Element e = (Element)it2.next();
				System.out.println(e.getAttributeValue("records"));
			}

Open in new window

0
 

Author Comment

by:jexpert7
ID: 35209333
Super, you are the best!!
0
 
LVL 86

Expert Comment

by:CEHJ
ID: 35209346
:)
0

Featured Post

Ransomware: The New Cyber Threat & How to Stop It

This infographic explains ransomware, type of malware that blocks access to your files or your systems and holds them hostage until a ransom is paid. It also examines the different types of ransomware and explains what you can do to thwart this sinister online threat.  

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
stackato and cloud 4 85
reverse digits of a number using for loop 5 41
The Best Website Creation Tools 14 55
Configure a Bean in an XML file 4 31
SASS allows you to treat your CSS code in a more OOP way. Let's have a look on how you can structure your code in order for it to be easily maintained and reused.
ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.
The viewer will learn the basics of jQuery including how to code hide show and toggles. Reference your jQuery libraries: (CODE) Include your new external js/jQuery file: (CODE) Write your first lines of code to setup your site for jQuery…

772 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question