[2 days left] What’s wrong with your cloud strategy? Learn why multicloud solutions matter with Nimble Storage.Register Now


awk - xml parsing

Posted on 2010-11-13
Medium Priority
Last Modified: 2012-05-10
I wanted to print the tag name after <Transaction> in the attached file. That is I wanted to print "AirAvailability_12". I did the following

awk '
   if ( $2 == "Transaction") n=1;
   if ( n == 2 ) {
   print $2;
   if ( n == 1) n++;

This works in s.txt  but not s1.txt (both files attached).

Any thoughts? Appreciate if someone points something I am missing.
Question by:vignesh_prabhu
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions

Author Comment

ID: 34127943
s.txt and s1.txt have the same contents. Only formatting differs.
LVL 68

Expert Comment

ID: 34127989
That's because in s1.txt there is no linefeed between >Transaction> and <AirAvailability_12>.

You'll have to do something like

awk '{FS="[<>]"; if($6 == "Transaction") print $8}' s1.txt

Author Comment

ID: 34128034
I am sorry but I do not see any output when I execute

awk '{FS="[<>]"; if($6 == "Transaction") print $8}' s1.txt
What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

LVL 68

Accepted Solution

woolmilkporc earned 2000 total points
ID: 34128338
I have to be sorry - I overlooked that there are no linefeeds at all!

So please try

awk 'BEGIN {FS="[<>]"} {for (i=1;i<=NF;i++) if($i=="Transaction") print $(i+2)}'

Open in new window

LVL 80

Expert Comment

ID: 34128727
To make the awk script uniform, you should convert the single line XML file s1.txt into one matching s.txt.
I.e. create a perl script that will go and reformat the xml file that is being fed into a common format.  I.e. you define which types of entries must be on a line by them selves, which entries have the open value close. etc.

Are there multiple processes that generate these XML files.

IMHO it is easier to make the input file have uniform layout versus trying to come up with a script that will match any variation.

Expert Comment

ID: 34129152
May a propose a different approach than awk?

xpath will deliver the first element after Transaction (with all it's childs), so cut out the first shown element and you have the name of the element directly following Transaction, and it does not matter how the XML is formatted, or how often Transaction is in the HTML:

xpath file.xml "//Transaction/*[1]" 2>/dev/null | sed -e 's/^<\([^>]*\)>.*/\1/g'

Open in new window

"//Transaction/*[1]"  <- Xpath query to select the first element after all Transaction elements

2>/dev/null <- Xpath has some additional output on stderr, eliminate it

sed -e  's/^<\([^>]*\)>.*/\1/g' <- cut aut the first element to display it

xpath should be available or easily installable on any unix

Author Comment

ID: 34130842
arnold - Yes, the XML needs to be formatted so the script works. Unfortunately the XML are always in the s1.txt format. To be on the safer side, I have slightly modified woolmilkporc code as below. This works for both s.txt and s1.txt.

awk '
for (i=1;i<=NF;i++) {
 if ($i != "") {
  if ($i == "Transaction") {
  if (j==1) {
  print $i

Thanks woolmilkporc.

hatrix76 - Thanks for the suggestion. Unfortunately I do not have xpath installed in our servers. Requested the admin to do so. Until then I have to go with the awk variant.

Featured Post

Veeam Disaster Recovery in Microsoft Azure

Veeam PN for Microsoft Azure is a FREE solution designed to simplify and automate the setup of a DR site in Microsoft Azure using lightweight software-defined networking. It reduces the complexity of VPN deployments and is designed for businesses of ALL sizes.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I. Introduction There's an interesting discussion going on now in an Experts Exchange Group — Attachments with no extension (http://www.experts-exchange.com/discussions/210281/Attachments-with-no-extension.html). This reminded me of questions tha…
In part one, we reviewed the prerequisites required for installing SQL Server vNext. In this part we will explore how to install Microsoft's SQL Server on Ubuntu 16.04.
The viewer will learn how to create and use a small PHP class to apply a watermark to an image. This video shows the viewer the setup for the PHP watermark as well as important coding language. Continue to Part 2 to learn the core code used in creat…
In this fourth video of the Xpdf series, we discuss and demonstrate the PDFinfo utility, which retrieves the contents of a PDF's Info Dictionary, as well as some other information, including the page count. We show how to isolate the page count in a…
Suggested Courses

656 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question