Solved

Saving portions of a large file - theoretical problem

Posted on 2008-10-27
1
225 Views
Last Modified: 2013-12-01
Lets say you had a large file (e.g. 500mb big). You were told that the following sections of the file had been modified:

0mb - 1mb
1mb - 2mb
50mb - 51mb

And you wanted to copy those blocks of data out of the file, saving it as a backup somewhere that is about 3mb big.

You're told that at some point in the future you will have to restore this file based only on a) the original file, and b) the blocks that you saved. You will have to merge them to recreate the file from it's two parts. When the time comes, you won't have any special premade tools to do it with, short of maybe a readme.txt that you wrote for yourself. You'll only have regular windows or linux commands and software, and whatever you can easily google up.

If you knew this situation would happen, and you could store those 3 megabytes of data in any format you desired, how would YOU go about storing the blocks of data such that you would be able to restore it later?

I'm trying to explore the idea of backing up only portions of a file, but doing it in such a way that any relatively knowledgable person could restore the backup without any special software. It is kind-of a theoretical question, not looking for any concrete solutions, just some ideas.
0
Comment
Question by:Frosty555
1 Comment
 
LVL 11

Accepted Solution

by:
jgmontgo earned 500 total points
ID: 22819848
Im not too sure such a theoretical situation might exist where A) one could successfully backup part of a file without special software and b) that any relatively knowledgable person could restore the backup without any special software.
There is already software that, in one way or another, already addresses this kind of situation. That said here goes.
The problems that one must overcome might include a) how to know that the original file was not modified after the backup, assuming it is time to restore the file. Then b) exactly how are you going to place those contents in just the right location of the file. My concern would be primarily for the integrity of the data.
It is not a problem (using simple off the shelf or OS provided tools) to reassemble a file that is broken into multiple pieces, the problem is restoring one or more section of data that needed to be restored.
If I were to attempt this I would store the file in some sort of binary format, not knowing what kind of file I was dealing with. Of course, if I knew it was a text file that would be a different matter. The data, as it turns out, is as imporntant as the question. An executable, sound file, graphic file, etc is one matter and a text file is entirely different. Then you have database files, this might be easier if it were a database, but then you would need the database tools to allow this to happen.
The application I was referring to is Acronis True Image. While it is not absolutely unique, there is a feature that speaks to what you are asking here. They have the ability to backup an entire drive, partition or set of any of the above as an image. If you were to restore that backup you would have what you started with. What makes them unique is the fact that they allow for an incrimental image backup. In other words, if something changes only the changes are backed up. Now I do not know if they backup just the changes or the entire changed file, but I do know that the backup is very efficient. The restore is equally interesting. If you have a years worth of daily backups, you can pick a single file from a single day, or the entire image from that day, at any point in the backup archive.
 
0

Featured Post

IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

I use more than 1 computer in my office for various reasons. Multiple keyboards and mice take up more than just extra space, they make working a little more complicated. Using one mouse and keyboard for all of my computers makes life easier. This co…
Today, still in the boom of Apple, PC's and products, nearly 50% of the computer users use Windows as graphical operating systems. If you are among those users who love windows, but are grappling to keep the system's hard drive optimized, then you s…
To efficiently enable the rotation of USB drives for backups, storage pools need to be created. This way no matter which USB drive is installed, the backups will successfully write without any administrative intervention. Multiple USB devices need t…
This tutorial will walk an individual through configuring a drive on a Windows Server 2008 to perform shadow copies in order to quickly recover deleted files and folders. Click on Start and then select Computer to view the available drives on the se…

708 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now