Solved

Saving portions of a large file - theoretical problem

Posted on 2008-10-27
1
230 Views
Last Modified: 2013-12-01
Lets say you had a large file (e.g. 500mb big). You were told that the following sections of the file had been modified:

0mb - 1mb
1mb - 2mb
50mb - 51mb

And you wanted to copy those blocks of data out of the file, saving it as a backup somewhere that is about 3mb big.

You're told that at some point in the future you will have to restore this file based only on a) the original file, and b) the blocks that you saved. You will have to merge them to recreate the file from it's two parts. When the time comes, you won't have any special premade tools to do it with, short of maybe a readme.txt that you wrote for yourself. You'll only have regular windows or linux commands and software, and whatever you can easily google up.

If you knew this situation would happen, and you could store those 3 megabytes of data in any format you desired, how would YOU go about storing the blocks of data such that you would be able to restore it later?

I'm trying to explore the idea of backing up only portions of a file, but doing it in such a way that any relatively knowledgable person could restore the backup without any special software. It is kind-of a theoretical question, not looking for any concrete solutions, just some ideas.
0
Comment
Question by:Frosty555
1 Comment
 
LVL 11

Accepted Solution

by:
jgmontgo earned 500 total points
ID: 22819848
Im not too sure such a theoretical situation might exist where A) one could successfully backup part of a file without special software and b) that any relatively knowledgable person could restore the backup without any special software.
There is already software that, in one way or another, already addresses this kind of situation. That said here goes.
The problems that one must overcome might include a) how to know that the original file was not modified after the backup, assuming it is time to restore the file. Then b) exactly how are you going to place those contents in just the right location of the file. My concern would be primarily for the integrity of the data.
It is not a problem (using simple off the shelf or OS provided tools) to reassemble a file that is broken into multiple pieces, the problem is restoring one or more section of data that needed to be restored.
If I were to attempt this I would store the file in some sort of binary format, not knowing what kind of file I was dealing with. Of course, if I knew it was a text file that would be a different matter. The data, as it turns out, is as imporntant as the question. An executable, sound file, graphic file, etc is one matter and a text file is entirely different. Then you have database files, this might be easier if it were a database, but then you would need the database tools to allow this to happen.
The application I was referring to is Acronis True Image. While it is not absolutely unique, there is a feature that speaks to what you are asking here. They have the ability to backup an entire drive, partition or set of any of the above as an image. If you were to restore that backup you would have what you started with. What makes them unique is the fact that they allow for an incrimental image backup. In other words, if something changes only the changes are backed up. Now I do not know if they backup just the changes or the entire changed file, but I do know that the backup is very efficient. The restore is equally interesting. If you have a years worth of daily backups, you can pick a single file from a single day, or the entire image from that day, at any point in the backup archive.
 
0

Featured Post

NAS Cloud Backup Strategies

This article explains backup scenarios when using network storage. We review the so-called “3-2-1 strategy” and summarize the methods you can use to send NAS data to the cloud

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A Bare Metal Image backup allows for the restore of an entire system to a similar or dissimilar hardware. They are highly useful for migrations and disaster recovery. Bare Metal Image backups support Full and Incremental backups. Differential backup…
In 2017, ransomware will become so virulent and widespread that if you aren’t a victim yourself, you will know someone who is.
This tutorial will walk an individual through locating and launching the BEUtility application and how to execute it on the appropriate database. Log onto the server running the Backup Exec database. In a larger environment, this would generally be …
This tutorial will walk an individual through locating and launching the BEUtility application to properly change the service account username and\or password in situation where it may be necessary or where the password has been inadvertently change…

832 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question