IIS Logging

We are sending our IIS logs offsite for 90-day retention on-hand, and then further 365-day retention in archives. This adds up to over 350GB of logs per year for us, and is costing us a lot. We are doing this to meet PCI compliance.

We would like to cut down on our IIS logs without sacrificing security or compliance. From the list below, please list all non-essential items that we can cut. Thanks much.

Date
Time
Client IP Address
User Name
Service Name
Server Name
Server IP Address
Server Port
Method
URI Stem
URI Query
Protocol Status
Protocol Substatus
Win32 Status
Bytes Sent
Bytes Received
Time Taken
Protocol Version
Host
User Agent
Cookie
Referer
LVL 8
pzozulkaAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

David Johnson, CD, MVPOwnerCommented:
This adds up to over 350GB of logs per year for us, and is costing us a lot. you could compress these files using zip or winrar before sending to your storage provider.. These files are highly compressible. 350GB on Amazon Glacier is probably a lot cheaper than what you are paying now.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Dan McFaddenSystems EngineerCommented:
Dropping a field from your http logs will not make that great of a difference in the size of your log files.  The log size is governed more by the activity on the website.  More activity equals larger logs... 1 or 2 less fields won't make a difference.

I agree with what David said above.  Http logs are simple text files and compress like a champ.  Compression will get you around an 85-90% reduction in file size.

Dan
0
pzozulkaAuthor Commented:
These are not compressible as they need to be sent in either plain text or JSON for further analysis, monitoring, reporting, and trending for PCI compliance. We are sending them to loggly.com.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Security

From novice to tech pro — start learning today.