# Elastic no throttling index for shard **URL:** \ **Category:** Elasticsearch\ **Created:** [October 16, 2019, 12:08pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828 "2019-10-16T12:08:28Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Tianji\_Zhao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tianji_zhao/32/48260_2.png) [@Tianji\_Zhao](https://discuss.elastic.co/u/Tianji_Zhao)\ **Post date:** [October 16, 2019, 12:08pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/1 "2019-10-16T12:08:28Z")
I use elastic to get information from logstash. With the index's number increase the elastic crash down.The log of elastic is as follow: [2019-10-16T06:59:50,535][WARN][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][386] overhead, spent [1.2s] collecting in the last [1.2s] [2019-10-16T06:59:52,661][WARN][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][387] overhead, spent [1.8s] collecting in the last [2.1s] [2019-10-16T06:59:54,121][WARN][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][388] overhead, spent [1.2s] collecting in the last [1.4s] java.lang.OutOfMemoryError: Java heap space Dumping heap to data/java\_pid1.hprof ... Heap dump file created [1217555017 bytes in 16.880 secs] [2019-10-16T07:01:02,385][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [c himeo-docker-single-node] fatal error in thread [elasticsearch[chimeo-docker-sin gle-node][write][T#6]], exiting ---
**Author:** ![Tianji\_Zhao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tianji_zhao/32/48260_2.png) [@Tianji\_Zhao](https://discuss.elastic.co/u/Tianji_Zhao)\ **Post date:** [October 16, 2019, 12:09pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/2 "2019-10-16T12:09:13Z")
java.lang.OutOfMemoryError: Java heap space [2019-10-16T07:01:02,383][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [c himeo-docker-single-node] fatal error in thread [elasticsearch[chimeo-docker-sin gle-node][write][T#8]], exiting java.lang.OutOfMemoryError: Java heap space at org.apache.lucene.util.ByteBlockPool$DirectTrackingAllocator.getByteB lock(ByteBlockPool.java:103) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25dd b152501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.util.ByteBlockPool.nextBuffer(ByteBlockPool.java:20 3) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimc zi - 2019-02-04 23:16:28] at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:268) ~[luce ne-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimczi - 2019 -02-04 23:16:28] at org.apache.lucene.index.SortedSetDocValuesWriter.addOneValue(SortedSe tDocValuesWriter.java:124) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb1 52501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.SortedSetDocValuesWriter.addValue(SortedSetDo cValuesWriter.java:90) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb15250 1ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.DefaultIndexingChain.indexDocValue(DefaultInd exingChain.java:616) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501a b5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultInde xingChain.java:467) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab 5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] ---
**Author:** ![Tianji\_Zhao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tianji_zhao/32/48260_2.png) [@Tianji\_Zhao](https://discuss.elastic.co/u/Tianji_Zhao)\ **Post date:** [October 16, 2019, 12:09pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/3 "2019-10-16T12:09:22Z")
at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultI ndexingChain.java:394) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb15250 1ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(Docum entsWriterPerThread.java:251) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25d db152501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWrite r.java:494) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3 d5 - jimczi - 2019-02-04 23:16:28] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1 616) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - ji mczi - 2019-02-04 23:16:28] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1235 ) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimcz i - 2019-02-04 23:16:28] at org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine. java:1164) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(Interna lEngine.java:1109) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.ja va:924) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:824) ~ [elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexSha rd.java:791) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary (IndexShard.java:744) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.lambda$execute IndexRequestOnPrimary$3(TransportShardBulkAction.java:454) ~[elasticsearch-6.7.0 .jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction$$Lambda$3384/0 x0000000801cf4840.get(Unknown Source) ~[?:?] at org.elasticsearch.action.bulk.TransportShardBulkAction.executeOnPrima ryWhileHandlingMappingUpdates(TransportShardBulkAction.java:477) ~[elasticsearch -6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.executeIndexRe questOnPrimary(TransportShardBulkAction.java:452) ~[elasticsearch-6.7.0.jar:6.7. 0] at org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkIte mRequest(TransportShardBulkAction.java:216) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrima ry(TransportShardBulkAction.java:159) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrima ry(TransportShardBulkAction.java:151) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperation OnPrimary(TransportShardBulkAction.java:139) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperation OnPrimary(TransportShardBulkAction.java:79) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.support.replication.TransportReplicationActi on$PrimaryShardReference.perform(TransportReplicationAction.java:1050) ~[elastic search-6.7.0.jar:6.7.0] at org.elasticsearch.action.support.replication.TransportReplicationActi on$PrimaryShardReference.perform(TransportReplicationAction.java:1028) ~[elastic search-6.7.0.jar:6.7.0] at org.elasticsearch.action.support.replication.ReplicationOperation.exe cute(ReplicationOperation.java:105) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.support.replication.TransportReplicationActi on$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.ja va:424) ~[elasticsearch-6.7.0.jar:6.7.0] at org.elasticsearch.action.support.replication.TransportReplicationActi on$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:370) ~[elas ticsearch-6.7.0.jar:6.7.0] vmware@vmware:~$ ---
**Author:** ![Tianji\_Zhao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tianji_zhao/32/48260_2.png) [@Tianji\_Zhao](https://discuss.elastic.co/u/Tianji_Zhao)\ **Post date:** [October 16, 2019, 12:19pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/4 "2019-10-16T12:19:18Z")
cluster.name: "chimeo-docker-cluster" node.name: "chimeo-docker-single-node" network.host: 0.0.0.0 http.cors.enabled: true http.cors.allow-origin: "\*" http.cors.allow-headers: "Authorization" discovery.zen.ping.unicast.hosts: ["10.0.0.1","10.0.0.2","10.0.0.3"] network.publish\_host: 10.117.4.38 #index.merge.scheduler.max\_thread\_count: 10 #index.merge.scheduler.max\_merge\_count: 10 #indices.store.throttle.type: none ---
**Author:** ![Tianji\_Zhao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tianji_zhao/32/48260_2.png) [@Tianji\_Zhao](https://discuss.elastic.co/u/Tianji_Zhao)\ **Post date:** [October 16, 2019, 12:21pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/5 "2019-10-16T12:21:51Z")
import requests import json payload={ "index\_patterns": ["\*"], "settings":{ "index.merge.scheduler.max\_thread\_count" : "10", "index.merge.scheduler.max\_merge\_count" : "10" #"indices.store.throttle.type" : "none" } } r=requests.put('[http://localhost:9200/\_template/template\_1?pretty](http://localhost:9200/_template/template_1?pretty)', headers={'Content-Type':'application/json'},data=json.dumps(payload)) print(r.text) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 13, 2019, 12:21pm UTC](https://discuss.elastic.co/t/elastic-no-throttling-index-for-shard/203828/6 "2019-11-13T12:21:57Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.