Replace special characters XML file

Posted on 2011-03-02
Last Modified: 2013-11-19
I receive an XML that I run through an XSLT process each day; however, the occasional special character causes this to break. I am looking for some utility that will clean the XML & replace special characters with correct html numeric encoding. I have identified one  small program(SSR), but I don't believe it would work well for multiple iterations. Just need an idea or a utility. Thanks!
Question by:mtnseeker
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 3
  • 3
  • +1
LVL 45

Expert Comment

ID: 35026594

What kind of special characters are you seeing and what do these need to be changed into?
LVL 29

Expert Comment

ID: 35028326
You should attach a sample file that contains the character -- just a shortened sample.

Author Comment

ID: 35029860
basically what happens is within the CDATA a user will sometimes put in a fairly common special character such as ¢ and I will have to manually convert this to ¢ (correct html numeric encoding).  Basically I just need to iterate over the XML with a pre set list of special characters; probably just the basic symbols.
Instantly Create Instructional Tutorials

Contextual Guidance at the moment of need helps your employees adopt to new software or processes instantly. Boost knowledge retention and employee engagement step-by-step with one easy solution.

LVL 45

Expert Comment

ID: 35030592
Since you already have XSLT code, you could do the following

Create a routine that will iterate the values between 127 and 255.  For each value, invoke the fn:replace() function and then return the 'cleaned' string.

alternatively, use VBscript (or similar language) to do the same thing to the entire XML file, rather on the CDATA sections.  This would be a preprocess operation to your XSLT operation.
LVL 110

Expert Comment

by:Ray Paseur
ID: 35032762
If you have PHP available, this might be useful.
LVL 29

Expert Comment

ID: 35034205
What encoding uses your XML?  No explicit encoding means implicitly UTF-8.  The CDATA sections are no exception.  Does it mean that your XML is damaged by the character?  Or do you only want to replace the characters with code greater than 127 by the &#nnn; sequence to get the ASCII representation?

Author Comment

ID: 35038721
@pepr the XML is damaged and I need to replace the characters with the code greater than 127

the cdata will have the ¢, but i need to replace it with ¢ before i send to my XSLT processor

basically these one's:

&	&	&	ampersand
¢	¢	¢	cent
©	©	©	copyright
µ	µ	µ	micron
·	· ·	middle dot
¶	¶	¶	pilcrow (paragraph sign)
±	± ±	plus/minus
€	€	€	Euro
£	£	£	British Pound Sterling
®	®	®	registered
§	§	§	section
™	™	™	trademark
¥	¥	¥	Japanese Yen

Open in new window

LVL 45

Accepted Solution

aikimark earned 500 total points
ID: 35038876
In doing more research on this problem, I encountered a previously unknown XSLT feature -- character-map element
LVL 29

Expert Comment

ID: 35039560
Why do you think the XML is damaged?  The ¢ is equal to ¢, isn't it?

Author Closing Comment

ID: 35040522
Mhat is exactly what I was looking...makes for a very beautiful solution just using straight XSLT

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
maven disable workspace resolution 1 41
Vector, list Questions R 6 47
Start Auto-download of File when page loads? 1 32
Add a loading gif while php runs server side 15 67
Get to know the ins and outs of building a web-based ERP system for your enterprise. Development timeline, technology, and costs outlined.
Because your company can’t afford for you to make SEO mistakes, you’ll want to ensure you’re taking the right steps each and every time you post a new piece of content. This list of optimization do’s and don’ts can help you become an SEO wizard.
With the power of JIRA, there's an unlimited number of ways you can customize it, use it and benefit from it. With that in mind, there's bound to be things that I wasn't able to cover in this course. With this summary we'll look at some places to go…
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…

733 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question