Storing large scale of data in XML? is it feasible?

Posted on 2011-10-22
Medium Priority
Last Modified: 2013-11-18

Hello group,

I'm receiving data from a piece of hardware through RS232 serial connection and rather than saving data into a DB I want to store them in XML files. One thing I'm worry about is that sometimes I might get large scale of data from memory such as 8 x 8K or 2 x 8K data. (all 0s and 1s)

How can I store it into leaf in XML? what would be the downside of it?

Any help i appreciated.

Question by:akohan

Accepted Solution

chrisbray earned 1000 total points
ID: 37014318
The question is how you want to store it.  If you want each 0 or 1 to have a tag it would fill up and break pretty quickly.

If you want to have one tag for each piece of data then it is probably viable, but in general a database would be more effective at retrieving the data is would be able to go directly to the data instead of working through a huge text file.

I have seen XML files as big as 16Gb so it is not impossible, just not necessarily a good idea...

Chris Bray

Author Closing Comment

ID: 37033398
Thank you.

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Entity Framework is a powerful tool to help you interact with the DataBase but still doesn't help much when we have a Stored Procedure that returns more than one resultset. The solution takes some of out-of-the-box thinking; read on!
SASS allows you to treat your CSS code in a more OOP way. Let's have a look on how you can structure your code in order for it to be easily maintained and reused.
Viewers will learn about if statements in Java and their use The if statement: The condition required to create an if statement: Variations of if statements: An example using if statements:
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Suggested Courses

850 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question