?
Solved

xml to full database website

Posted on 2011-03-21
1
Medium Priority
?
188 Views
Last Modified: 2012-05-11
Hi,

I recently got a hold on some xml files which contains alot of information on items from a game.
Now for the moment that file is about 240mb big :D Now I found out that there are quite alot of information that can just be deleted to bring it down to 20mb... But anyways.

Now there are a few questions I would like to ask you experts:

After opening it in FireFox it says there UTF-8 invalid characters. Is there an easy way using an editor to remove/replace them?

Should I keep this xml as it is and cache the retrieved info? Or set everything in a database (mysql)? If so what's the easiest way of transfering the data?
Connected to this question: I would like my users to use a bbcode and enter the desired name (exact name) of an item which makes it possible for them to auto generate an image with the info as a hover-tooltip. Should I keep an eye on server overload issues? Also can this be done with a simple "for each item with name -> show"?

Has anyone maybe made this before? Or are there any resources online I could use?

Kind regards
0
Comment
Question by:Mutsop
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
1 Comment
 
LVL 111

Accepted Solution

by:
Ray Paseur earned 2000 total points
ID: 35181798
there UTF-8 invalid characters  
Often this happens if there are Western European characters single-byte characters with values above decimal 127, but the encoding says, "UTF-8."  Often you can correct this by simply omitting the encoding or specifying ISO-8859-1, etc.  More information here:
http://www.joelonsoftware.com/articles/Unicode.html

keep this xml ... set everything in a database
You might do either or both.  It depends on what you want to do with the data.  XML is hierarchical, MySQL is relational.  If you're doing lookups on 240MB you might want the speed of a normalized and well-indexed data base.  It is data-dependent, and you would probably want to get a professional DBA involved in the project.  You will expect questions like, "where does the data come from?" and "how often is it updated or replaced?"

anyone maybe made this before?
Almost certainly - make a Google search for XML-to-MySQL and you will surely find something useful.  I have seem many projects where ignorant data architects have declared that they would stop using XML or data bases and start using only data bases or only XML.  None of these projects made much sense.  XML and MySQL are not fungible.
0

Featured Post

NEW Veeam Agent for Microsoft Windows

Backup and recover physical and cloud-based servers and workstations, as well as endpoint devices that belong to remote users. Avoid downtime and data loss quickly and easily for Windows-based physical or public cloud-based workloads!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This post looks at MongoDB and MySQL, and covers high-level MongoDB strengths, weaknesses, features, and uses from the perspective of an SQL user.
In this blog post, we’ll look at how using thread_statistics can cause high memory usage.
The viewer will learn how to dynamically set the form action using jQuery.
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB. To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question