Advertisement

05.07.2008 at 11:57PM PDT, ID: 23385236 | Points: 500
[x]
Attachment Details
Japanese character set
What are the problems one may encounter while using Japanese character set. How can they be solved.

I came to know that Japanese character set is a 2 byte character set. Will it have any effect on my application which we intend to develop in Japanese.

Start your free trial to view this solution
Question Stats
Zone: Programming
Question Asked By: thomas908
Question Asked On: 05.07.2008
Participating Experts: 4
Points: 500
Views: 0
Translate:
Loading Advertisement...
05.08.2008 at 12:00AM PDT, ID: 21522801

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:08AM PDT, ID: 21522823

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:11AM PDT, ID: 21522836

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:12AM PDT, ID: 21522838

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:15AM PDT, ID: 21522855

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:20AM PDT, ID: 21522884

Rank: Master

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:20AM PDT, ID: 21522885

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:31AM PDT, ID: 21522925

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 12:36AM PDT, ID: 21522943

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:16AM PDT, ID: 21523089

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:19AM PDT, ID: 21523104

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:32AM PDT, ID: 21523156

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:42AM PDT, ID: 21523203

Rank: Guru

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:42AM PDT, ID: 21523205

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:51AM PDT, ID: 21523237

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 01:51AM PDT, ID: 21523238

Rank: Genius

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
05.08.2008 at 02:03AM PDT, ID: 21523269

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
Microsoft
  • Internet Protocols
  • Applications
  • Development
  • OS
  • Hardware
  • Windows Security
Apple
  • Operating Systems
  • Hardware
  • Programming
  • Networking
  • Software
Internet
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Spy / Ad Blockers
  • Web Browsers
  • New Net Users
  • Web Development
  • Chat / IM
  • Anti Spam
  • Web Servers
  • Anti-Virus
  • Email Clients
Gamers
  • Tips
  • Online / MMORPG
  • Puzzle
  • Emulators
  • Action / Adventure
  • Role Playing
  • Consoles
  • Game Programming
  • Strategy
  • Sports
  • Misc
  • Computer Games
Digital Living
  • Hardware
  • New Net Users
  • New Users
  • Software
  • Digital Music
  • Gaming World
  • Home Security
  • Apple
  • Networking Hardware
Virus & Spyware
  • Vulnerabilities
  • IDS
  • Encryption
  • Anti-Virus
  • Operating Systems Security
  • Software Firewalls
  • WebApplications
  • Cell Phones
  • Operating Systems
  • Internet
  • Hardware Firewalls
Hardware
  • Handhelds / PDAs
  • Displays / Monitors
  • Components
  • Networking Hardware
  • Peripherals
  • Laptops/Notebooks
  • Storage
  • Servers
  • Desktops
  • New Users
  • Misc
  • Apple
Software
  • System Utilities
  • Industry Specific
  • Network Management
  • Photos / Graphics
  • Page Layout
  • VMWare
  • Misc
  • Web Development
  • OS
  • CYGWIN
  • Voice Recognition
  • Message Queue
  • Quality Assurance
  • Security
  • Firewalls
  • MultiMedia Applications
  • Development
  • Database
  • Office / Productivity
  • Business Management
  • OS/2 Apps
  • Server Software
  • Internet / Email
ITPro
  • OS
  • Storage
  • Encryption
  • Operating Systems Security
  • Apple Hardware
  • Laptops & Notebooks
  • Servers
  • Networking Hardware
  • Peripherals
  • Devices
  • Displays / Monitors
  • WebTrends / Stats
  • Search Engines
  • Firewalls
  • WebApplications
  • IDS
  • Vulnerabilities
  • Email Clients
  • File Sharing
  • Spy / Ad Blockers
  • Web Browsers
  • Web Servers
  • Networking
  • Anti-Virus
  • Chat / IM
  • Anti Spam
Developer
  • Web Servers
  • Web Browsers
  • Game Programming
  • Dev Tools
  • Industry Specific
  • Office / Productivity
  • Database
  • CYGWIN
  • Web Development
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Programming
  • Content Management
  • Application Servers
  • Protocols
Storage
  • Removable Backup Media
  • Storage Technology
  • Servers
  • Grid
  • Remote Access
  • Backup / Restore
  • Misc
  • Hard Drives
OS
  • Miscellaneous
  • Security
  • Development
  • Linux
  • VMWare
  • MainFrame OS
  • Unix
  • Apple
  • OS / 2
  • AS / 400
  • BeOS
  • Microsoft
  • VMS / OpenVMS
Database
  • Oracle
  • Miscellaneous
  • MySQL
  • Software
  • Sybase
  • Contact Management
  • PostgreSQL
  • Data Manipulation
  • Clarion
  • InterSystems Cache
  • Siebel
  • MUMPS
  • OLAP
  • SQLBase
  • SAS
  • GIS & GPS
  • 4GL
  • Berkeley DB
  • DB2
  • Informix
  • Interbase / Firebird
  • FoxPro
  • Reporting
  • LDAP
  • Filemaker Pro
  • MS SQL Server
  • dBase
  • MS Access
Security
  • Misc
  • Web Browsers
  • Software Firewalls
  • Operating Systems Security
  • File Sharing
  • Spy / Ad Blockers
  • Vulnerabilities
  • WebApplications
  • IDS
  • Anti-Virus
  • Encryption
  • Anti Spam
  • Email Clients
  • VPN
  • Chat / IM
Programming
  • Editors IDEs
  • Installation
  • Handhelds / PDAs
  • Multimedia Programming
  • System / Kernel
  • Algorithms
  • Game
  • Signal Processing
  • Project Management
  • Open Source
  • Database
  • Misc
  • Languages
  • Processor Platforms
  • Theory
Web Development
  • Scripting
  • Blogs
  • Web Servers
  • Software
  • Search Engines
  • Web Graphics
  • Images
  • Internet Marketing
  • Images and Photos
  • Components
  • Document Imaging
  • Web Languages/Standards
  • Illustration
  • WebApplications
  • Fonts
  • WebTrends / Stats
  • Authoring
  • Digital Camera Software
  • Miscellaneous
Networking
  • Protocols
  • Apple Networking
  • Network Management
  • Message Queue
  • Application Servers
  • Content Management
  • File Servers
  • Email Servers
  • Misc
  • Java Editors & IDEs
  • Wireless
  • Networking Hardware
  • Backup / Restore
  • System Utilities
  • ISPs & Hosting
  • Web Servers
  • Storage Technology
  • Removable Backup Media
  • Servers
  • Broadband
  • Grid
  • OS / 2
  • Novell Netware
  • Unix Networking
  • Windows Networking
  • Security
  • Telecommunications
  • Operating Systems
  • Linux Networking
Other
  • Community Advisor
  • Lounge
  • Community Support
  • New Net Users
  • Philosophy / Religion
  • Math / Science
  • Miscellaneous
  • URLs
  • Expert Lounge
  • Politics
  • Puzzles / Riddles
Community Support
  • Suggestions
  • New to EE
  • New Topics
  • Community Advisor
  • CleanUp
  • Announcements
  • General
  • Feedback
  • Input
  • EE Bugs
 
05.08.2008 at 12:00AM PDT, ID: 21522801

Rank: Genius

Well i wouldn't want to frighten you ;-)

Seriously, the main things to watch are that you use the right in/out encodings. It's only 2 byte in Unicode in UTF-16. This is the encoding you should use if you have mainly Japanese. If you have a lot of Western characters too, use UTF-8
 
05.08.2008 at 12:08AM PDT, ID: 21522823
Thanks for replying.

Can you please elaborate what does in/out encoding mean?
 
05.08.2008 at 12:11AM PDT, ID: 21522836
Also, will using UTF-16 cause any problems.
 
05.08.2008 at 12:12AM PDT, ID: 21522838

Rank: Genius

> I came to know that Japanese character set is a 2 byte character set. Will it have any
> effect on my application which we intend to develop in Japanese.

Java support asian character sets without problem.
Just ensure you use an appropriate encoding at all time.

 
05.08.2008 at 12:15AM PDT, ID: 21522855
Also, do different softwares support UTF-16. Suppose my XML contains Japanese characters. Does the parser which can be used for parsing the XML use UTF-16. I guess it won't work without that. Similarly are there other problems like this that one may encounter while using Japanese characters.
 
05.08.2008 at 12:20AM PDT, ID: 21522884

Rank: Master

Java internally deals with 2 bytes characters, which is ok. What you must take care is the encoding used for "reading" files and the encoding used for "writing" files.

See here:

http://java.sun.com/j2se/1.4.2/docs/guide/intl/encoding.doc.html
 
05.08.2008 at 12:20AM PDT, ID: 21522885

Rank: Genius

UTF-16 will be fine. In fact it's the closest to Java's own way of dealing with character encoding. It's widely supported. Just make sure you use Reader rather than InputStream when parsing and set the Reader, via InputStreamReader, to UTF-16
 
05.08.2008 at 12:31AM PDT, ID: 21522925

Rank: Genius

>  Suppose my XML contains Japanese characters. Does the parser which can be used for parsing the XML use UTF-16.

the parser will need to use whatever encoding was used to create the xml.
Just ensure you use the same encodig to read that was used to write.
If if its a webapp ensure you use the appropriate encoding for your pages.

 
05.08.2008 at 12:36AM PDT, ID: 21522943

Rank: Genius

You should try to use UTF_16 throughout rather than any other Asian encodings
 
05.08.2008 at 01:16AM PDT, ID: 21523089
Any reason for not using UTF-8? I read somewhere that UTF-8 also supports Japanese
 
05.08.2008 at 01:19AM PDT, ID: 21523104

Rank: Genius

Yes. UTF-8 is good when you've got plenty of Western text too. Otherwise it becomes less efficient, oftern using  3 bytes and even 4 per char
 
05.08.2008 at 01:32AM PDT, ID: 21523156

Rank: Genius

we use UTF8 without a problem

 
05.08.2008 at 01:42AM PDT, ID: 21523203
 
05.08.2008 at 01:42AM PDT, ID: 21523205
So does that mean that I can use either UTF-8 (will not be very efficient but that's not a major concern right now) or UTF-16 without any problems. The only things that I need to watch out for is.

1. Reading and Writing of files should be done using Reader/Writer and not InputStream/OutputStream
2. If there is any other software that I am using (like XML parsers), they should also use the same encoding (UTF-8 or UTF-16) with which the file (which needs to be parsed) was created.

Is the above correct? Are these the only 2 things I need to take care of?
 
05.08.2008 at 01:51AM PDT, ID: 21523237

Rank: Genius

That's right
 
05.08.2008 at 01:51AM PDT, ID: 21523238

Rank: Genius

> 1. Reading and Writing of files should be done using Reader/Writer and not InputStream/OutputStream

depends whether you're reading/writing strings or not. If your just dealing with the biytes then a stream is fine.

Database encoding is another thing to ensure is correct

 
05.08.2008 at 02:03AM PDT, ID: 21523269
Thank You.

So here's the updated list

We can use either UTF-8 (should be used if there is plenty of Western text too. Otherwise it becomes less efficient, often using  3 bytes and even 4 per char) or UTF-16 without any problems. The only things that one need to watch out for while using Japanese characters are

1. Reading and Writing of files should be done using Reader/Writer (Java internally handles the encoding) and not InputStream/OutputStream
2. If there is any other software that is being used (like XML parsers), they should also use the same encoding (UTF-8 or UTF-16) with which the file (which needs to be parsed) was created.
3. Database encoding is another thing to ensure is correct

If any expert is aware of some other issue as well, please add to the list
 
 
20080236-EE-VQP-29 / EE_QW_2_20070628