?
Solved

SaxParser exception and Apache

Posted on 2006-06-09
18
Medium Priority
?
436 Views
Last Modified: 2012-06-27
I'm making the same request to two different webservers: one is made directly to the JRun webserver (HTTP1.0) and the other through Apache(HTTP1.1).
The xml returned is the same and contains some extended-ascii chars like à,ò,ù....
The first request is parsed by SAX without problems, the second one generates this exception

"Unconvertible UTF-8 character beginning with 0xf9"

and clearly is related to the extended-ascii char "ù". Since the returned xml is identical, the problem should be in the http headers. Note that the working xml is sent over HTTP1.0 and the wrong one over HTTP1.1. Can this make the difference?
Why sax assumes that the xml is UTF-8 encoded while clearly specified that is ISO-8859-1 encoded?

Here the headers of the both requests:

HTTP/1.1 200 OK
Date: Thu, 08 Jun 2006 15:01:09 GMT
Server: Apache/2.0.54 (Unix) JRun/4.0
Connection: close
Content-Type: text/html; charset=ISO-8859-1

<?xml version="1.0" encoding="iso-8859-1"?>


HTTP/1.0 200 OK
Date: Thu, 08 Jun 2006 15:00:45 GMT
Content-Type: text/html; charset=ISO-8859-1
Server: JRun Web Server

<?xml version="1.0" encoding="iso-8859-1"?>

Any ideas?
Thank you
Andrea

0
Comment
Question by:bugada
  • 4
  • 4
  • 3
  • +3
16 Comments
 
LVL 7

Expert Comment

by:Igor Bazarny
ID: 16868668
Hmm, could it be that you parse results in different ways? What's the client which parses responce?
0
 
LVL 10

Author Comment

by:bugada
ID: 16868798
The client is the same... the only difference is the HTTP protocol version due to the Apache between Jrun Server and the client... if i request the resource directly to the Jrun Server, the xml is parsed correctly.

Can i force sax to parse an xml with a certain encoding (in this case ISO-8859-1)?
0
The 14th Annual Expert Award Winners

The results are in! Meet the top members of our 2017 Expert Awards. Congratulations to all who qualified!

 
LVL 10

Author Comment

by:bugada
ID: 16868863
@hoomanv: that's not my case, beacause my XML is NOT UTY-8 encoded.
As you can see from charset=ISO-8859-1 and encoding="iso-8859-1" I want sax parse it using latin-western charset...
But it seems to use UTF-8 instead. Why?
0
 
LVL 7

Expert Comment

by:Igor Bazarny
ID: 16868950
How do you create InputSource for your parser? Could encoding be messed at this point?
0
 
LVL 7

Expert Comment

by:Igor Bazarny
ID: 16868994
Try to use InputSource(Reader) constructor and pass desired encoding to reader constructor
0
 
LVL 4

Expert Comment

by:Yagantappa
ID: 16869135
Verify your Apache configuration file (httpd.conf). Apache might be converting your xml file.
0
 
LVL 14

Expert Comment

by:hoomanv
ID: 16869156
should Content-Type be text/xml or application/xml ?
0
 
LVL 4

Expert Comment

by:Yagantappa
ID: 16869169
It should be application/xml for xml files
0
 
LVL 30

Expert Comment

by:Mayank S
ID: 16869507
>> But it seems to use UTF-8 instead. Why?

Can we see some of the parsing code?
0
 
LVL 10

Author Comment

by:bugada
ID: 16869853
Here an extract of the code used to parse the xml...

SAXParser parser = getSAXParser();
URL url = new URL(u);
HttpURLConnection conn = (HttpURLConnection) url.openConnection();
conn.setDoOutput(true);
InputStream is = conn.getInputStream();
parser.parse(is, handler);

I noted that if i use an InputStreamReader the method getEncoding() returns "ASCII", but i don't know if it's related or not with my problem...
0
 
LVL 30

Expert Comment

by:Mayank S
ID: 16869900
I think that's because its the default used by the platform. Perhaps that's the problem with JRun too....

Can you try using the setProperty () method of SAXParser to set the encoding explicity to what you want, before you call parse ()? I'm not sure if it is possible but might be worth exploring.
0
 
LVL 10

Author Comment

by:bugada
ID: 16885038
Ok thank you all for your effort, but i think I found the solution.

The method getInputStream() seems to ignore the encoding when using HTTP1.1.

I'm using this code as a workaround (it preserves the encoding)

InputStream in = conn.getInputStream();
byte[] tmp = new byte[512];

ByteArrayOutputStream out = new ByteArrayOutputStream();
int bytesRead = in.read(tmp);

while (bytesRead != -1) {
      out.write(tmp, 0, bytesRead);
      bytesRead = in.read(tmp);
}
in.close();

byte[] data = out.toByteArray();
ByteArrayInputStream bais = new ByteArrayInputStream(data);
parser.parse(bais, handler);

Comments and suggestion welcomed.
Andrea

0
 
LVL 30

Expert Comment

by:Mayank S
ID: 16886034
You can convert a byte-array output stream to a String using:

String contents = out.toString ( encoding ) ; // here, you can specify the encoding

Then you can use that as your initial contents for parsing.
0
 
LVL 30

Expert Comment

by:Mayank S
ID: 17079256
Its ok, but make sure you specify the encoding as I'd suggested.
0
 
LVL 5

Accepted Solution

by:
Netminder earned 0 total points
ID: 17105381
Closed, 250 points refunded.
Netminder
Site Admin
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Go is an acronym of golang, is a programming language developed Google in 2007. Go is a new language that is mostly in the C family, with significant input from Pascal/Modula/Oberon family. Hence Go arisen as low-level language with fast compilation…
A discussion about automated testing of Web Applications utilizing Selenium, along with illustrated configuration steps for the Jenkins open source tool.
This tutorial covers a practical example of lazy loading technique and early loading technique in a Singleton Design Pattern.
How to fix incompatible JVM issue while installing Eclipse While installing Eclipse in windows, got one error like above and unable to proceed with the installation. This video describes how to successfully install Eclipse. How to solve incompa…

589 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question