Want to win a PS4? Go Premium and enter to win our High-Tech Treats giveaway. Enter to Win

x
?
Solved

xml to full database website

Posted on 2011-03-21
1
Medium Priority
?
190 Views
Last Modified: 2012-05-11
Hi,

I recently got a hold on some xml files which contains alot of information on items from a game.
Now for the moment that file is about 240mb big :D Now I found out that there are quite alot of information that can just be deleted to bring it down to 20mb... But anyways.

Now there are a few questions I would like to ask you experts:

After opening it in FireFox it says there UTF-8 invalid characters. Is there an easy way using an editor to remove/replace them?

Should I keep this xml as it is and cache the retrieved info? Or set everything in a database (mysql)? If so what's the easiest way of transfering the data?
Connected to this question: I would like my users to use a bbcode and enter the desired name (exact name) of an item which makes it possible for them to auto generate an image with the info as a hover-tooltip. Should I keep an eye on server overload issues? Also can this be done with a simple "for each item with name -> show"?

Has anyone maybe made this before? Or are there any resources online I could use?

Kind regards
0
Comment
Question by:Mutsop
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
1 Comment
 
LVL 111

Accepted Solution

by:
Ray Paseur earned 2000 total points
ID: 35181798
there UTF-8 invalid characters  
Often this happens if there are Western European characters single-byte characters with values above decimal 127, but the encoding says, "UTF-8."  Often you can correct this by simply omitting the encoding or specifying ISO-8859-1, etc.  More information here:
http://www.joelonsoftware.com/articles/Unicode.html

keep this xml ... set everything in a database
You might do either or both.  It depends on what you want to do with the data.  XML is hierarchical, MySQL is relational.  If you're doing lookups on 240MB you might want the speed of a normalized and well-indexed data base.  It is data-dependent, and you would probably want to get a professional DBA involved in the project.  You will expect questions like, "where does the data come from?" and "how often is it updated or replaced?"

anyone maybe made this before?
Almost certainly - make a Google search for XML-to-MySQL and you will surely find something useful.  I have seem many projects where ignorant data architects have declared that they would stop using XML or data bases and start using only data bases or only XML.  None of these projects made much sense.  XML and MySQL are not fungible.
0

Featured Post

Get your Conversational Ransomware Defense e‑book

This e-book gives you an insight into the ransomware threat and reviews the fundamentals of top-notch ransomware preparedness and recovery. To help you protect yourself and your organization. The initial infection may be inevitable, so the best protection is to be fully prepared.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article shows the steps required to install WordPress on Azure. Web Apps, Mobile Apps, API Apps, or Functions, in Azure all these run in an App Service plan. WordPress is no exception and requires an App Service Plan and Database to install
In this blog post, we’ll look at how ClickHouse performs in a general analytical workload using the star schema benchmark test.
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …
Suggested Courses

618 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question