Posts Tagged Amazon
While I reflected on some Enterprise based use and benefits. However, my personal interest lies in using AWS Glacier for providing long archival storage for personal data (photos, videos, and music).
Notes from AWS S3 documentation:
- Amazon S3 will archive objects for you and associate those objects with the Glacier storage class according to rules that you define.
- When you transition objects to the Glacier storage class, AWS S3 internally uses AWS Glacier for durable storage at lower cost.
I’ve used the following transition rule:
I’ve been able to confirm the following events work seamlessly:
- Items with ‘Storage Class – Glacier’ are not overwritten | re-copied by the scheduled back up process to the S3 bucket.
- Deleting items – delete in the S3 bucket and the Glacier vault.
- Overwriting a file (same filename), re-creates it in the S3 bucket, and then it is transitioned to Glacier as per the rule sets.
- The Prefix setting needs to use the full directory | folder structure in the target S3 bucket to the location of the target files.
I will now start transitioning my other S3 bucket stores from AWS S3 – RRS to AWS Glacier. I will track the charges and costs of storage and data transfer as this process goes forward, I do anticipate a spike in data transfer costs for the bulk migration of content from AWS S3 – RRS to AWS Glacier.
Are you thinking of using the AWS Glacier service?
Again, while I don’t claim expertise on the “cloud computing” phenomena let alone storage, it is an area that fascinates me for delivering technology and service based innovation. Especially considering all the data proliferation era that is often spoken about in statistical superlatives (e.g. article from Forbes).
Now the concepts around Information Lifecycle Management, and Digital Asset Management and the use of Hierarchical storage management or the related Automated Tiered Storage are not new, and there is a lot of traditional technology around to deliver or cover some of those aspects.
Tiered storage is a data storage environment consisting of two or more kinds of storage delineated by differences in at least one of these four attributes: price, performance, capacity and function.
Any significant difference in one or more of the four defining attributes can be sufficient to justify a separate storage tier.
Automated Tiered Storage is the automated progression or demotion of data across different tiers (types) of storage devices and media. This movement of data is automatic to the different types of disk according to performance and capacity requirements.
So where does AWS come into this? Here’s how I see it:
same with recently updated iconography from: AWS Simple Icons
I think with the combination of AWS Storage Gateway, AWS S3 and AWS Glacier Amazon has pretty much got a wrap on this. This storage service combo gives cloud based hierarchical storage management, that has a gateway entry point into the traditional enterprise data center, rule based storage policies, an api as well as market leading price point. I think the CIO will soon find this an appealing combination, easing his/her cost concerns around storage of data and record archives necessary for compliance to various financial and legal stipulations.
Is that not an awesome combination!
Do you think they’re on to something?
Amazon Glacier is described as:
- Low cost– Amazon Glacieris an extremely low-cost, pay-as-you-go storage service that can cost as little as $0.01 per gigabyte per month, irrespective of how much data you store.
- Secure – Amazon Glaciersupports secure transfer of your data over Secure Sockets Layer (SSL) and automatically stores data encrypted at rest using Advanced Encryption Standard (AES) 256, a secure symmetric-key encryption standard using 256-bit encryption keys.
- Durable– Amazon Glacieris designed to provide average annual durability of 99.999999999% for each item stored.
- Flexible –Amazon Glacierscales to meet your growing and often unpredictable storage requirements. There is no limit to the amount of data you can store in the service.
- Simple– Amazon Glacier allows you to offload the administrative burdens of operating and scaling archival storage to AWS, and makes long term data archiving especially simple. You no longer need to worry about capacity planning, hardware provisioning, data replication, hardware failure detection and repair, or time-consuming hardware migrations.
- Designed for use with other Amazon Web Services – You can use AWS Import/Export to accelerate moving large amounts of data into Amazon Glacier using portable storage devices for transport. In the coming months, Amazon Simple Storage Service (Amazon S3) plans to introduce an option that will allow you to seamlessly move data between Amazon S3 and Amazon Glacier using data lifecycle policies.
I’m particularly interested in the domestic consumer potential, though obvious Enterprise application potential is huge too.
As a domestic consumer, I already use Synology NAS products, which integrate with Amazon S3 for schedule backup to a secure, cost efficient, off-site storage location. But as the Amazon Glacier FAQ points out :
Q: How should I choose between Amazon Glacier and Amazon Simple Storage Service (Amazon S3)? A:Amazon S3 is a durable, secure, simple, and fast storage service designed to make web-scale computing easier for developers.
- Use Amazon S3 if you need low latency or frequent access to your data.
- Use Amazon Glacier if low storage cost is paramount, your data is rarely retrieved, and data retrieval times of several hours are acceptable.
(high lighting by myself)In the coming months, Amazon S3 will introduce an option that will allow customers to seamlessly move data between Amazon S3 and Amazon Glacier based on data lifecycle policies.
So as a domestic consumer – my local NAS device provides all the rapid access to content I require. What I need from offsite storage, is to be stable secure and cost effective, so I am hoping Amazon Glacier can provide exactly that. Particularly, it will be the right place to store, photos, videos, and music content that once created and transfer to the appropriate folder can be kept on low cost storage like Amazon Glacier.
I certainly think Amazon Glacier is a step ahead of the rest of market, and set a very high barrier to market entry, with the delivery of such a low price point.
What do you think of Amazon Glacier – do you think you’ll end up as a user of the service?