# ElasticSearch multiple path.data not storing in all directories

**URL:** <https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526>\
**Category:** Elasticsearch\
**Created:** [October 11, 2017, 9:54am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526 "2017-10-11T09:54:58Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![hasan\_sharekhan](https://avatars.discourse-cdn.com/v4/letter/h/eada6e/32.png) [@hasan\_sharekhan](https://discuss.elastic.co/u/hasan_sharekhan)\
**Post date:** [October 11, 2017, 9:54am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/1 "2017-10-11T09:54:58Z")

</div>

I have 3 nodes of ElasticSearch v5.5 (node0, node1, node2)

I have set path.data to 5 different directories for each node on CentOS 7  
i.e. /elk\_data0, /elk\_data1, /elk\_data2, /elk\_data3, /elk\_data4

My problem is data is not getting stored on /elk\_data0

The size of /elk\_data0 is only 33MB and for other directories it is above 25GB

I found the below difference in /elk\_data0 with others

/elk\_data0/es\_data/node0/nodes/0/indices/1F8ljDHPQcunjWjVfnACnw  
In above directory /0/index/ is missing

/elk\_data1/es\_data/node0/nodes/0/indices/1F8ljDHPQcunjWjVfnACnw/0/index  
All directories from 1 - 4 is like the above directory

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 11, 2017, 9:59am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/2 "2017-10-11T09:59:32Z")

</div>

Each shard is stored in a single path. Do you have enough shards to cover all paths?

---

<div class="post-metadata">

**Author:** ![hasan\_sharekhan](https://avatars.discourse-cdn.com/v4/letter/h/eada6e/32.png) [@hasan\_sharekhan](https://discuss.elastic.co/u/hasan_sharekhan)\
**Post date:** [October 11, 2017, 10:04am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/3 "2017-10-11T10:04:01Z")

</div>

Thanks, I have currently 21 indices and 200 shards, but nothing is stored on /elk\_data0/ as compared other directory size 33 MB vs 25GB

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 11, 2017, 10:06am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/4 "2017-10-11T10:06:19Z")

</div>

Did you start out with this disk configuration before adding data to the cluster or change after data was already indexed? Is this imbalance causing any performance problems?

---

<div class="post-metadata">

**Author:** ![hasan\_sharekhan](https://avatars.discourse-cdn.com/v4/letter/h/eada6e/32.png) [@hasan\_sharekhan](https://discuss.elastic.co/u/hasan_sharekhan)\
**Post date:** [October 11, 2017, 10:11am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/5 "2017-10-11T10:11:22Z")

</div>

Thanks for your reply, now got it.

I started with 5 directories but for the first directory i had minor typing error in the path,

later i corrected it but till the time data was indexed, I believe sooner or later this directory with get data.

And I didn't faced any performance issue yet.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 11, 2017, 10:14am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/6 "2017-10-11T10:14:04Z")

</div>

I don't believe Elasticsearch will move shards between paths once they are placed, so if the path was initially incorrect, it would expect the imbalance. I would expect this to even out as you add additional indices/shards.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 8, 2017, 10:14am UTC](https://discuss.elastic.co/t/elasticsearch-multiple-path-data-not-storing-in-all-directories/103526/7 "2017-11-08T10:14:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
