<div>
I would explore different compression options. &nbsp;Performance is not an issue. compression % is the prime consideration. (7-zip, winzip, gzip, and rar are good candidates)<br />
<br />
Save some meta data in a database, allowing you to search for the log you need and then decompress it.
</div>


I would explore different compression options.  Performance is not an issue. compression % is the prime consideration. (7-zip, winzip, gzip, and rar are good candidates)

Save some meta data in a database, allowing you to search for the log you need and then decompress it.

<div>
I just did a test of an XML file and 7zip compressed it from 164k down to 10k = 6.556% of its original size. &nbsp;I got this reduction using both the Ultra and Maximum compression levels, both employing the PPMd compression method.
</div>


I just did a test of an XML file and 7zip compressed it from 164k down to 10k = 6.556% of its original size.  I got this reduction using both the Ultra and Maximum compression levels, both employing the PPMd compression method.

<div>
<div class="content wysiwyg-content">
I am having thousands of XML Requests/Responses Log with each log size can be anywhere 1mb to 10mb. We need to keep them only for investigation if something goes wrong. We need to able to locate and open the log file. As of now we are keeping the same in a folder on the server but since the daily usage of log files are 50-60 GB per day and frequently ran out of space. So my question is what is the best way of managing such data? Ideally i want it to be in a db that we can archive and search for it even after 3 months. Should i zip the same and keep the pointer in db?
</div>
</div>


I am having thousands of XML Requests/Responses Log with each log size can be anywhere 1mb to 10mb. We need to keep them only for investigation if something goes wrong. We need to able to locate and open the log file. As of now we are keeping the same in a folder on the server but since the daily usage of log files are 50-60 GB per day and frequently ran out of space. So my question is what is the best way of managing such data? Ideally i want it to be in a db that we can archive and search for it even after 3 months. Should i zip the same and keep the pointer in db?

Best Way to keep Huge XML Request and Response Logs.

Programming includes both the specifics of the language you’re using, like Visual Basic, .NET, Java and others, but also the best practices in user experience and interfaces and the management of projects, version control and development. Other programming topics are related to web and cloud development and system and hardware programming.