# Elasticsearch data directory in S3 bucket

**URL:** <https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945>\
**Category:** Elasticsearch\
**Created:** [October 12, 2023, 5:31pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945 "2023-10-12T17:31:14Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![zaeemmasood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zaeemmasood/32/102383_2.png) [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Post date:** [October 12, 2023, 5:31pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/1 "2023-10-12T17:31:14Z")

</div>

Hi All,

Is it possible to have the data directory of a newly built ES 8 cluster hosted on a S3 bucket.

Idea is for the data nodes to use S3 instead of local disk or NAS.

Thanks

---

<div class="post-metadata">

**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Post date:** [October 12, 2023, 5:34pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/2 "2023-10-12T17:34:39Z")

</div>

> [@zaeemmasood](#):
>
> Is it possible to have the data directory of a newly built ES 8 cluster hosted on a S3 bucket.

No, this is not possible.

---

<div class="post-metadata">

**Author:** ![zaeemmasood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zaeemmasood/32/102383_2.png) [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Post date:** [October 12, 2023, 5:54pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/3 "2023-10-12T17:54:31Z")

</div>

Thanks for a quick response.

We have a retention period of 30 days for the indices.

Can we move indices older than 7 days to S3 and how? Idea is to have more disk space available on local.

We have a cluster of 8 nodes with 5 data and 3 dedicated master nodes and indices are written into local disk on each data node.

Thanks

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 12, 2023, 6:03pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/4 "2023-10-12T18:03:23Z")

</div>

You can achieve this by configuring [searchable snapshots](https://www.elastic.co/guide/en/elasticsearch/reference/8.10/searchable-snapshots.html) in a hot-cold architecture. This does however require a [commercial Enterprise license](https://www.elastic.co/subscriptions). You can not have searchable data on S3 with the free basic license.

---

<div class="post-metadata">

**Author:** ![zaeemmasood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zaeemmasood/32/102383_2.png) [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Post date:** [October 12, 2023, 7:27pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/5 "2023-10-12T19:27:21Z")

</div>

Thanks. I have a very basic question.

In our case, all the data nodes are writing to their **local disks** and there is no common storage (e.g NAS) between the data nodes.

Can snapshots be taken in such set ups?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 12, 2023, 8:04pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/6 "2023-10-12T20:04:55Z")

</div>

Snapshots require shared storage, e.g NFS mount or S3.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 9, 2023, 8:05pm UTC](https://discuss.elastic.co/t/elasticsearch-data-directory-in-s3-bucket/344945/7 "2023-11-09T20:05:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
