I have a fairly large data collection system, which stores its data into an XML format.
This has two limitations:
1. Each file has approx 1000 <reading> tags, and there is much repeated text, I would like to be able to compress somehow to remove some of this bloat.
2. Data is stored in plaintext. The system is not human accessable but for CFR 21 reasons I want to at least have some sort of rudimentary tamper protection.
I am using LINQ to XML quite heavily, but ideally I want to compress, then encrypt each file also.
I am a bit stuck with how to continue here. Also, I generally access 30-100 of these files in quick succession. Is there a large processing overhead associated with compression and encryption in c#?