# Speed up shard allocation on Elasticsearch 6.x single node cluster

**URL:** <https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174>\
**Category:** Elasticsearch\
**Created:** [January 29, 2019, 1:07pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174 "2019-01-29T13:07:54Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Thomas\_Ardal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thomas_ardal/32/7956_2.png) [@Thomas\_Ardal](https://discuss.elastic.co/u/Thomas_Ardal)\
**Post date:** [January 29, 2019, 1:07pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/1 "2019-01-29T13:07:55Z")

</div>

I'm currently upgrading a "cluster" (with a single node) from Elasticsearch 1.x to 6.x. Everything is working out great, but I experience very slow shard allocation on 6.x. I don't remember if I did anything on the old cluster to speed things up. But on a single node cluster, shard allocation should be pretty straightforward.

Is shard allocation slower on 6.x or can I look through some settings on my 1.x node to see what is different?

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [January 29, 2019, 1:10pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/2 "2019-01-29T13:10:15Z")

</div>

> [@Thomas\_Ardal](#):
>
> But on a single node cluster, shard allocation should be pretty straightforward.

Indeed it should be. How many shards do you have in your cluster?

---

<div class="post-metadata">

**Author:** ![Thomas\_Ardal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thomas_ardal/32/7956_2.png) [@Thomas\_Ardal](https://discuss.elastic.co/u/Thomas_Ardal)\
**Post date:** [January 29, 2019, 1:29pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/3 "2019-01-29T13:29:01Z")

</div>

I have \>5,500 shards spread across around 1,800 indices. I totally understand that allocation takes some time with this amount of shards. The only thing I'm wondering about, is the performance difference between the two versions.

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [January 29, 2019, 1:46pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/4 "2019-01-29T13:46:23Z")

</div>

> [@Thomas\_Ardal](#):
>
> I have \>5,500 shards spread across around 1,800 indices.

This is far too many, and you will definitely see performance issues as a consequence. You should try and reduce this number. Here is an article about shard counts:

> **[How many shards should I have in my Elasticsearch cluster?](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster)**

> [@Thomas\_Ardal](#):
>
> The only thing I'm wondering about, is the performance difference between the two versions.

The 1.x series was a long time ago, and modern Elasticsearch does many things quite differently. I do not find it surprising that there's a performance difference in this area.

---

<div class="post-metadata">

**Author:** ![Thomas\_Ardal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thomas_ardal/32/7956_2.png) [@Thomas\_Ardal](https://discuss.elastic.co/u/Thomas_Ardal)\
**Post date:** [January 29, 2019, 1:55pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/5 "2019-01-29T13:55:46Z")

</div>

Thank you for the link to that blog post. Would love to have seen that earlier 🙂 I save log data for customers where a customer can have multiple logs (each log can store multiple log messages). Each log is represented by an index consisting of three shards. From what I can see in the article, I should probably have an index per customer, rather than per log per customer.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 26, 2019, 1:55pm UTC](https://discuss.elastic.co/t/speed-up-shard-allocation-on-elasticsearch-6-x-single-node-cluster/166174/6 "2019-02-26T13:55:51Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
