Issues in creating Write-Once-Read-Many(WORM) Archive Storage with Glacier

I am looking for some more help to solving the below problem:

Requirement :
To meet compliance requirement for data protection, we want to create separate S3 buckets which will temporarily store the and after completion of the specified duration the data should make it's way to  Glacier Vaults for archival. Our major requirement is to ensure that our archived data shouldn't be tempered. Data should be saved in a non-rewritable and no-erasable storage to ensure archived data protection.

I understand that Amazon Glacier Vault Lock allows to easily deploy and enforce compliance controls for individual Amazon Glacier vaults with a Vault Lock policy and we can specify controls such as “write once read many” (WORM) in a Vault Lock policy and lock the policy from future edits. But I'm facing an issue while testing this option.

Issue :

As our requirement is that some S3 buckets will retain information temporarily and after some time move the contents to glacier vault. My doubt is when I apply life cycle policy to an S3 bucket it doesn't shows the Vault name where it's gonna reside neither it ask while configuring life cycle policy to specify vault name so that later in glacier console we can easily apply lock-down policy to that specific vault.

I understand that to upload data, such as photos, videos, and other documents, we must either use the AWS CLI or write code to make requests, using either the REST API directly or by using the AWS SDKs. Does it mean there is no possible way to directly move S3 bucket objects to a specific Vault? Do we have to download all the contents first from S3 bucket which we want to archive and then upload then using AWS CLI to a specific Vault and then apply the vault lock-down policy to make the storage WORM compliance?
cloudtechnicianAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Stuart ScottAWS Content Lead at Cloud AcademyCommented:
Hi,

Having a quick look at this please look at the following 2 links:

https://forums.aws.amazon.com/thread.jspa?threadID=158968 - Which explains when trying to do what you are
When you use Glacier through S3, the latter service manages everything for you. The files are indeed stored in Glacier, but unfortunately not in your own vaults. Files that have been moved to Glacier will continue to be visible in your S3 buckets, now with Storage Class: Glacier. When you want to get data out of Glacier, you initiate a restore through S3.

However, you could take a look at a CloudBerry product which seems to be able to do what you need:
http://www.cloudberrylab.com/blog/how-to-move-cloudberry-backup-data-from-amazon-s3-to-glacier/

Hope this helps,

Cheers,

Stu...

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
cloudtechnicianAuthor Commented:
Thanks for the pointing me to the right direction.

Although, CloudBerry Cloud Migrator tool features looks quite useful but if I'm not wrong this product is not available. It's still in beta. I signed up for it and got a message " We will inform you when beta will become available and send you an email with a download link."
Stuart ScottAWS Content Lead at Cloud AcademyCommented:
Hi Cloudtechnician,

I have contacted CloudBerry Lab regarding this and they are working on getting a date to me hopefully in the next couple of days so I will let you know what they say with regards to this.

Aploogies, I didnt realise it was in beta development when I suggested this to you.

Cheers,

Stu...
Stuart ScottAWS Content Lead at Cloud AcademyCommented:
Hi,

I have recieved feedback from them explaining that its going to be a little while before this application is readily available.  However, I have asked the question regarding one of their other products that maybe able to do the same thing.  I shall get back to you ASAP.

Cheers,

Stu...
cloudtechnicianAuthor Commented:
Thanks Stuart for help. I also opened a case with them. This is what they mentioned :

you can back up your cloud account to another cloud account with CloudBerry Backup. Check out the link below for more info http://www.cloudberrylab.com/blog/cloudberry-backup-cloud-to-cloud-backup-functionality/
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
AWS

From novice to tech pro — start learning today.