Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

file archives in VB.NET

Posted on 2008-06-21
5
265 Views
Last Modified: 2013-11-26
What are some of the proven methods of archiving large quantities of files (e.g. millions of files, terabytes in size)? I'm looking for a way to retrieve/add files to an archive format VB.NET in such a way that it is still robust even if the archive is huge.

I have explored using ZIP files for archives, with Chilkat's libraries. There's a 4gb limit on zip archives though. I've thought about ISOs, TARs, maybe CAB files?

What other standardized formats exist out there specifically for archiving large quanties of files? Is there anything microsoft made, or reliable VB.NET classes that can manipulate them?
0
Comment
Question by:Frosty555
  • 2
  • 2
5 Comments
 
LVL 18

Expert Comment

by:Priest04
ID: 21837814
May I ask why do you compress files that result in such a large compressed file? If you have thousand/milions of small files thar result in one large compressed file, then damage to this file will make all files in it useless. Anyway, one of the options is

http://www.rarsoft.com/rar_archiver.htm

Goran

0
 
LVL 48

Accepted Solution

by:
jpaulino earned 500 total points
ID: 21838964
Another option ... SharpZipLib (http://www.icsharpcode.net/OpenSource/SharpZipLib/Default.aspx)

To be honest I don't know if it works with 4gb but you can try it!
0
 
LVL 31

Author Comment

by:Frosty555
ID: 21845731
>May I ask why do you compress files that result in such a large compressed file?
I'll be using the archives to store backups of files from the system (as well as from other sources). There can be many revisions of any single file in the archive, and file servers often have half a million files. Typically, each archive should be no larger than 4gb, small enough to store on a DVD, but I'm writing for scaleability.

>http://www.rarsoft.com/rar_archiver.htm
Does not hav a programmable interface... that I could see. I love RAR files but I don't see how I can use this.

>Another option ... SharpZipLib (http://www.icsharpcode.net/OpenSource/SharpZipLib/Default.aspx)
I see a lot of promise in this - supports zip, bzip, encryption, even tar files! But where's their documentation? Code examples? Can't seem to find much in the way of help.
0
 
LVL 48

Expert Comment

by:jpaulino
ID: 21845768
0
 
LVL 18

Expert Comment

by:Priest04
ID: 21848323
I dont know how long will you keep archived files, but if you intend to keep them longer than 2-3 years, DVDs shouldn't be an option, since they are not made to last long. There was a story about some company that had a climatized room, and they kept in there archiving files on DVDs, and after a couple of years (not remember exactly how many years) most of them were unreadable.

As for the winrar, it accepts command line parameters

http://www.respower.com/page_tutorial_unrar
0

Featured Post

Migrating Your Company's PCs

To keep pace with competitors, businesses must keep employees productive, and that means providing them with the latest technology. This document provides the tips and tricks you need to help you migrate an outdated PC fleet to new desktops, laptops, and tablets.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Visual Studios 1 76
location of a form 2 24
C#.net split string and then check appropriate checkboxlist 4 26
Easy filter aspnet 2 24
How to update Firmware and Bios in Dell Equalogic PS6000 Arrays and Hard Disks firmware update.
Microsoft will be releasing the Windows 10 Creators Update in just a matter of weeks. Are you prepared? Follow these steps to ensure everything goes smoothly and you don't lose valuable data on your PC.
To efficiently enable the rotation of USB drives for backups, storage pools need to be created. This way no matter which USB drive is installed, the backups will successfully write without any administrative intervention. Multiple USB devices need t…
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…

808 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question