# Elasticsearch poor indexing performance **URL:** \ **Category:** Elasticsearch\ **Created:** [November 3, 2017, 2:54pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327 "2017-11-03T14:54:03Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![apyshchyk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apyshchyk/32/23303_2.png) [@apyshchyk](https://discuss.elastic.co/u/apyshchyk)\ **Post date:** [November 3, 2017, 2:54pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/1 "2017-11-03T14:54:03Z")
Hi everyone, I have issues with ES indexing performance. First of all - current cluster setup 15 data nodes 8CPU, 32RAM 3 Master nodes 4CPU, 16 RAM external monitoring cluster. For current performance testing I'm sending 25K events/s, which is distributed by multiple indices (totally to ~ 600shards) sometimes I see huge performance degradation, looking into \_cat/thread\_pool/bulk I have a response like this ![47 PM](https://us1.discourse-cdn.com/elastic/original/3X/2/7/27478ac76b33284ce1d306cf146df19465779615.png) There is 10 threads of indexing applications, which hitting multiple indices during bulk insert Looks like only 1 data node is busy during this time, others 14 - doing nothing. after a while - speed get back to normal. How to prevent this situation? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [November 3, 2017, 3:26pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/2 "2017-11-03T15:26:35Z")
Which Elasticsearch version are you using? What is the size of your documents? What indexing throughput are you seeing? What size bulk requests are you using? ---
**Author:** ![apyshchyk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apyshchyk/32/23303_2.png) [@apyshchyk](https://discuss.elastic.co/u/apyshchyk)\ **Post date:** [November 3, 2017, 3:32pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/3 "2017-11-03T15:32:02Z")
Forgot to mention, ES Version 5.5.0 indexing throughput when all nodes are loaded ~ 20-25K event/s indexing throughput when only one got huge bulk queue - 3-5K events/s IDocument size ~1Kb Bulk size - 10Mb ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [November 3, 2017, 3:37pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/4 "2017-11-03T15:37:00Z")
What is the ratio between inserts of new data and updates to existing documents? Are you using parent-child or nested documents? ---
**Author:** ![apyshchyk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apyshchyk/32/23303_2.png) [@apyshchyk](https://discuss.elastic.co/u/apyshchyk)\ **Post date:** [November 3, 2017, 4:19pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/5 "2017-11-03T16:19:19Z")
~5 updates per 5 Millions documents (when message accidently sent twice) No any parent-child or nested documents, ---
**Author:** ![apyshchyk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apyshchyk/32/23303_2.png) [@apyshchyk](https://discuss.elastic.co/u/apyshchyk)\ **Post date:** [November 3, 2017, 8:23pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/6 "2017-11-03T20:23:03Z")
![09 PM](https://us1.discourse-cdn.com/elastic/original/3X/c/2/c2a0ccb05cff8d9302d290dfb8b2dfec8bd487b8.jpg) Only indexing is happening in ES Cluster now, but speed is fluctuating a lot (speed is total for primary and replica, to have real indexing speed, divide by 2) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 1, 2017, 8:23pm UTC](https://discuss.elastic.co/t/elasticsearch-poor-indexing-performance/106327/7 "2017-12-01T20:23:24Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.