# CEPH Storage For Elasticsearch

**URL:** <https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775>\
**Category:** Elasticsearch\
**Created:** [August 9, 2021, 8:37am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775 "2021-08-09T08:37:46Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ankita\_Pachauri](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ankita_pachauri/32/61469_2.png) [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\
**Post date:** [August 9, 2021, 8:37am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/1 "2021-08-09T08:37:46Z")

</div>

We are planning to create an Elasticsearch cluster over Kubernetes, and for this CEPH distributed file system would be used as Storage, I understand that elastic recommends using local storage, however are there any known performance issues or other issues in general using CEPH. Has anyone from elastic tested Elasticsearch 7 on CEPH storage?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 9, 2021, 8:49am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/2 "2021-08-09T08:49:29Z")

</div>

I did a quick search and found the following reasonably recent threads:

> [@Elasticsearch support for Distributed FS like Rook-ceph](https://discuss.elastic.co/t/elasticsearch-support-for-distributed-fs-like-rook-ceph/199410):
>
> Hi, Does Elasticsearch architecture supports Distributed File system for storage like rook-ceph?

> [@Is ElasticSearch supports CephRBD or CephRBD-fast with RWO access?](https://discuss.elastic.co/t/is-elasticsearch-supports-cephrbd-or-cephrbd-fast-with-rwo-access/256759):
>
> Is ElasticSearch supports CephRBD or CephRBD-fast with RWO access ?

> [@Rook ceph for Elastic Search](https://discuss.elastic.co/t/rook-ceph-for-elastic-search/275647):
>
> Hello, We are deploying elastic search on kubernetes farm and we have rook ceph as our distributed storage. I was going through earlier topic and there was enough reason than with ES being heavy used for File system. But, is there a plan at this point to support distributed storage? what is the recommendation for kubernetes based deployments with distributed storage ?

> [@Elasticsearch IOPS](https://discuss.elastic.co/t/elasticsearch-iops/265680):
>
> Hello Team I am having Elasticsearch version 5.6.3 running on RHEL 7.4. This Cluster is of 10 nodes. Hardware : 8 CPU and 32 GB RAM. Hard Disk : HDD { CEPH Storage } Elastic Data Paths : Multiple { 7 Different mount points }. We are logging logs data into this ES cluster. When we are performing IO Test using "fio" tool , we are getting throughput of sequential write to multiple mount points as below WRITE: bw=20.3MiB/s (21.3MB/s), 20.3MiB/s-20.3MiB/s (21.3MB/s-21.3MB/s), io=24.0GiB (25.8G…

I am not aware of any recent changes that would change the recommendations in these posts.

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [August 9, 2021, 8:58am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/3 "2021-08-09T08:58:33Z")

</div>

On CEPH it works .. but its quite slow. You might face multiple Timeout Issues for internal operations of Elasticsearch and some of your own operations you would be performing on Elasticsearch Cluster.

You might split the roles of Nodes ... to have less overhead on actual data nodes ...

---

<div class="post-metadata">

**Author:** ![Ankita\_Pachauri](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ankita_pachauri/32/61469_2.png) [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\
**Post date:** [August 11, 2021, 11:38am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/4 "2021-08-11T11:38:19Z")

</div>

For licensed elasticsearch cluster, would the elasticsearch support team help with issues arising on cluster running ceph storage?  
Can someone from elasticsearch answer this?

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [August 11, 2021, 11:59am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/5 "2021-08-11T11:59:09Z")

</div>

It sort of depends what you mean by "support". Everyone gets the same level of help, which includes assistance with diagnosing performance issues, but if the diagnosis determines your storage is too slow for your needs (or behaves incorrectly under load) then that's something you would be responsible for fixing.

Distributed storage is slower than local storage because that's how physics works unfortunately, it's not something you can work around with a support contract.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 8, 2021, 11:59am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775/6 "2021-09-08T11:59:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
