Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

xml to full database website

Posted on 2011-03-21
1
183 Views
Last Modified: 2012-05-11
Hi,

I recently got a hold on some xml files which contains alot of information on items from a game.
Now for the moment that file is about 240mb big :D Now I found out that there are quite alot of information that can just be deleted to bring it down to 20mb... But anyways.

Now there are a few questions I would like to ask you experts:

After opening it in FireFox it says there UTF-8 invalid characters. Is there an easy way using an editor to remove/replace them?

Should I keep this xml as it is and cache the retrieved info? Or set everything in a database (mysql)? If so what's the easiest way of transfering the data?
Connected to this question: I would like my users to use a bbcode and enter the desired name (exact name) of an item which makes it possible for them to auto generate an image with the info as a hover-tooltip. Should I keep an eye on server overload issues? Also can this be done with a simple "for each item with name -> show"?

Has anyone maybe made this before? Or are there any resources online I could use?

Kind regards
0
Comment
Question by:Mutsop
1 Comment
 
LVL 109

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 35181798
there UTF-8 invalid characters  
Often this happens if there are Western European characters single-byte characters with values above decimal 127, but the encoding says, "UTF-8."  Often you can correct this by simply omitting the encoding or specifying ISO-8859-1, etc.  More information here:
http://www.joelonsoftware.com/articles/Unicode.html

keep this xml ... set everything in a database
You might do either or both.  It depends on what you want to do with the data.  XML is hierarchical, MySQL is relational.  If you're doing lookups on 240MB you might want the speed of a normalized and well-indexed data base.  It is data-dependent, and you would probably want to get a professional DBA involved in the project.  You will expect questions like, "where does the data come from?" and "how often is it updated or replaced?"

anyone maybe made this before?
Almost certainly - make a Google search for XML-to-MySQL and you will surely find something useful.  I have seem many projects where ignorant data architects have declared that they would stop using XML or data bases and start using only data bases or only XML.  None of these projects made much sense.  XML and MySQL are not fungible.
0

Featured Post

How Do You Stack Up Against Your Peers?

With today’s modern enterprise so dependent on digital infrastructures, the impact of major incidents has increased dramatically. Grab the report now to gain insight into how your organization ranks against your peers and learn best-in-class strategies to resolve incidents.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Get a subdirectory name from a url 5 27
Wordpress Only run code if on a certain page 11 22
JQuery Search Filter 2 28
Append data to an XML file 3 14
These days socially coordinated efforts have turned into a critical requirement for enterprises.
Introduction This article is intended for those who are new to PHP error handling (https://www.experts-exchange.com/articles/11769/And-by-the-way-I-am-New-to-PHP.html).  It addresses one of the most common problems that plague beginning PHP develop…
The viewer will learn how to dynamically set the form action using jQuery.
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.

839 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question