# S3 Intelligent-Tiering class with Deep Archive Access tier for snapshots is working?

**URL:** <https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122>\
**Category:** Elasticsearch\
**Tags:** snapshot-and-restore\
**Created:** [September 1, 2023, 11:42am UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122 "2023-09-01T11:42:18Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![mihai1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mihai1/32/123421_2.png) [@mihai1](https://discuss.elastic.co/u/mihai1)\
**Post date:** [September 1, 2023, 11:42am UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/1 "2023-09-01T11:42:18Z")

</div>

We're currently utilizing Elasticsearch version 8.8.1 and storing our daily snapshots in S3 using the 'Intelligent\_Tiering' storage class. In an effort to optimize costs, based on AWS's documentation on Intelligent Tiering says that " objects not accessed for 180 days are moved to the Deep Archive Access tier with up to 95% in storage cost savings."

However, it's important to note that this could impact data availability, as data won't be instantly accessible. Has anyone experimented with this approach? Are there any risks of data loss associated with it?

I understand that Glacier Deep is not supported, but the "Deep Archive tier" is essentially incorporated into "Intelligent Tiering," which is now natively supported by Elasticsearch snapshots.

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [September 4, 2023, 3:49pm UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/2 "2023-09-04T15:49:10Z")

</div>

> [@mihai1](#):
>
> data won't be instantly accessible

I haven't tried it, but I'm pretty sure this means it won't work with Elasticsearch snapshots today. Elasticsearch needs the data to be instantly accessible.

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [September 4, 2023, 3:52pm UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/3 "2023-09-04T15:52:07Z")

</div>

[Amazon S3 Intelligent-Tiering Storage Class | AWS](https://aws.amazon.com/s3/storage-classes/intelligent-tiering/) says:

> If the object you are retrieving is stored in the optional Deep Archive tier, before you can retrieve the object you must first restore a copy using `RestoreObject`.

Elasticsearch definitely doesn't know how to do this.

---

<div class="post-metadata">

**Author:** ![mihai1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mihai1/32/123421_2.png) [@mihai1](https://discuss.elastic.co/u/mihai1)\
**Post date:** [September 8, 2023, 7:58am UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/4 "2023-09-08T07:58:55Z")

</div>

thank you @DavidTurner for your answer.

However, if we manually initiate the RestoreObject process, the data will automatically transition to the Frequent Access Tier and become accessible again. Elasticsearch should then be able to detect it. right?

On the other side, I think one potential drawback to consider is that the retention of the backup may be affected and not function correctly, as the data won't be immediately accessible.

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [September 8, 2023, 9:39am UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/5 "2023-09-08T09:39:33Z")

</div>

That's true, but I don't think there's a way for you to work out which objects need to be restored.

---

<div class="post-metadata">

**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Post date:** [September 8, 2023, 11:47am UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/6 "2023-09-08T11:47:22Z")

</div>

One suggestion, but I'm not sure this will work for you, is to use another cloud provider, in this case Google Cloud Storage.

We had similar requirements to save money with snapshots and decided to use GCP because how their storage tiering works.

When you move between the storage classes, it will not change the objects, it will change the pricing for the API requests related to the object, the data is still immediately accessible, but it costs more to list, read and retrieve.

In our case we have daily and monthly indices, so we have policy that changes the storage classes from Standard to Coldline after 31 days

The retention of the snapshots are not affected by this since DELETE operations on the objects are free in any storage classes after their required retention time.

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [September 8, 2023, 12:41pm UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/7 "2023-09-08T12:41:56Z")

</div>

GCS's [autoclass](https://cloud.google.com/storage/docs/autoclass) feature is pretty similar to S3's Intelligent Tiering, it's just that S3 goes even colder than GCS does with their Deep-Archive tier. But that's an opt-in feature, it should work fine on S3 as long as you don't opt in.

(NB I haven't done a pricing comparison between the two, maybe GCS is cheaper, but maybe not)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 6, 2023, 12:42pm UTC](https://discuss.elastic.co/t/s3-intelligent-tiering-class-with-deep-archive-access-tier-for-snapshots-is-working/342122/8 "2023-10-06T12:42:02Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
