Posts Tagged Amazon

Now actively using Amazon Glacier

image

I’ve written a couple of times about the recently released AWS service AWS Glacier:

While I reflected on some Enterprise based use and benefits. However, my personal interest lies in using AWS Glacier for providing long archival storage for personal data (photos, videos, and music).

Now that AWS S3 integration with AWS Glacier is available (see announcement),  and that Synology NAS natively support back up to AWS S3 (see feature description).

So I’ve been testing the AWS Glacier vault integration with the storage buckets I have in AWS S3.

The AWS S3 Test folder linked to AWS Glacier  has the following common software binaries:

image

Notes from AWS S3 documentation:

Therefore you don’t need to connect|link AWS S3 to AWS Glacier vaults yourself.

I’ve used the following transition rule:

image 

I’ve been able to confirm the following events work seamlessly:

  • Items with ‘Storage Class – Glacier’ are not overwritten | re-copied by the scheduled back up process to the S3 bucket.
  • Deleting items – delete in the S3 bucket and the Glacier vault.
  • Overwriting a file (same filename), re-creates it in the S3 bucket, and then it is transitioned to Glacier as per the rule sets.
  • The Prefix setting needs to use the full directory | folder structure in the target S3 bucket to the location of the target files.

I will now start transitioning my other S3 bucket stores from AWS S3 – RRS to AWS Glacier.  I will track the charges and costs of storage and data transfer as this process goes forward, I do anticipate a spike in data transfer costs for the bulk migration of content from AWS S3 – RRS to AWS Glacier

Are you thinking of using the AWS Glacier service?

, , , , ,

Leave a comment

AWS – Storage Lifecycle Management

image

Again, while I don’t claim expertise on the “cloud computing” phenomena let alone storage, it is an area that fascinates me for delivering technology and service based innovation.   Especially considering all the data proliferation era that is often spoken about in statistical superlatives (e.g. article from Forbes).

In particular I have considerable admiration for Amazon and their AWS business aspect, and I’m not alone in this respect – as this article points out.

I recently wrote a post about the Amazon Glacier storage service.  This is a follow up post.

AWS has recently brought out announcements on AWS S3 integration with AWS Glacier  and about enhancements to their AWS Storage Gateway with Gateway Cached Volumes.

Now the concepts around Information Lifecycle Management, and Digital Asset Management and the use of Hierarchical storage management or the related Automated Tiered Storage are not new, and there is a lot of traditional technology around to deliver or cover some of those aspects.

Tiered storage is a data storage environment consisting of two or more kinds of storage delineated by differences in at least one of these four attributes: price, performance, capacity and function.

Any significant difference in one or more of the four defining attributes can be sufficient to justify a separate storage tier.

Automated Tiered Storage is the automated progression or demotion of data across different tiers (types) of storage devices and media. This movement of data is automatic to the different types of disk according to performance and capacity requirements.

Beiges Buchbinderleinen (Sold)

So where does AWS come into this?  Here’s how I see it:

AWS_SLM

same with recently updated iconography from: AWS Simple Icons

AWS_SLM2

I think with the combination of AWS Storage Gateway, AWS S3 and AWS Glacier  Amazon has pretty much got a wrap on this.  This storage service combo gives cloud based hierarchical storage management, that has a gateway entry point into the traditional enterprise data center, rule based storage policies, an api as well as market leading price point.   I think the CIO will soon find this an appealing combination, easing his/her cost concerns around storage of data and record archives necessary for compliance to various financial and legal stipulations.

Is that not an awesome combination!

Do you think they’re on to something?

, , , , , , , , ,

1 Comment

Amazon–intent on Freezing out the competition for low cost storage with Glacier

Amazon Web Services (AWS) – recently released their Glacier their extreme lost-cost storage, archive, and backup service.

Amazon Glacier is described as:

    • Low costAmazon Glacieris an extremely low-cost, pay-as-you-go storage service that can cost as little as $0.01 per gigabyte per month, irrespective of how much data you store.
    • SecureAmazon Glaciersupports secure transfer of your data over Secure Sockets Layer (SSL) and automatically stores data encrypted at rest using Advanced Encryption Standard (AES) 256, a secure symmetric-key encryption standard using 256-bit encryption keys.
    • DurableAmazon Glacieris designed to provide average annual durability of 99.999999999% for each item stored.
    • FlexibleAmazon Glacierscales to meet your growing and often unpredictable storage requirements. There is no limit to the amount of data you can store in the service.
    • SimpleAmazon Glacier allows you to offload the administrative burdens of operating and scaling archival storage to AWS, and makes long term data archiving especially simple. You no longer need to worry about capacity planning, hardware provisioning, data replication, hardware failure detection and repair, or time-consuming hardware migrations.
    • Designed for use with other Amazon Web Services – You can use AWS Import/Export to accelerate moving large amounts of data into Amazon Glacier using portable storage devices for transport. In the coming months, Amazon Simple Storage Service (Amazon S3) plans to introduce an option that will allow you to seamlessly move data between Amazon S3 and Amazon Glacier using data lifecycle policies.
Getting Started with Amazon Glacier

I’m particularly interested in the domestic consumer potential, though obvious Enterprise application potential is huge too.

As a domestic consumer, I already use Synology NAS products, which integrate with Amazon S3 for schedule backup to a secure, cost efficient, off-site storage location.  But as the Amazon Glacier FAQ points out :

Q: How should I choose between Amazon Glacier and Amazon Simple Storage Service (Amazon S3)? A:Amazon S3 is a durable, secure, simple, and fast storage service designed to make web-scale computing easier for developers.

  • Use Amazon S3 if you need low latency or frequent access to your data.
  • Use Amazon Glacier if low storage cost is paramount, your data is rarely retrieved, and data retrieval times of several hours are acceptable.

(high lighting by myself)

In the coming months, Amazon S3 will introduce an option that will allow customers to seamlessly move data between Amazon S3 and Amazon Glacier based on data lifecycle policies.

So as a domestic consumer – my local NAS device provides all the rapid access to content I require. What I need from offsite storage, is to be stable secure and cost effective, so I am hoping Amazon Glacier can provide exactly that.  Particularly, it will be the right place to store, photos, videos, and music content that once created and transfer to the appropriate folder can be kept on low cost storage like Amazon Glacier.

I am really looking forward to the further integration of Amazon S3 and Amazon Glacier, but also direct support of Amazon Glacier by Synology.

I certainly think Amazon Glacier is a step ahead of the rest of market, and set a very high barrier to market entry, with the delivery of such a low price point.

What do you think of Amazon Glacier – do you think you’ll end up as a user of the service?

, , , , ,

2 Comments

  • ARCHIVES

  • CATEGORIES

  • CALENDAR

    May 2017
    M T W T F S S
    « Nov    
    1234567
    891011121314
    15161718192021
    22232425262728
    293031  
  • Enter your email address to follow this blog and receive updates of new posts by email.

    Join 15 other followers

%d bloggers like this: