Elastic no throttling index for shard

Elastic Stack Elasticsearch
1

I use elastic to get information from logstash. With the index's number increase the elastic crash down.The log of elastic is as follow:

[2019-10-16T06:59:50,535][WARN ][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][386] overhead, spent [1.2s] collecting in the last [1.2s]
[2019-10-16T06:59:52,661][WARN ][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][387] overhead, spent [1.8s] collecting in the last [2.1s]
[2019-10-16T06:59:54,121][WARN ][o.e.m.j.JvmGcMonitorService] [chimeo-docker-sin gle-node] [gc][388] overhead, spent [1.2s] collecting in the last [1.4s]
java.lang.OutOfMemoryError: Java heap space
Dumping heap to data/java_pid1.hprof ...
Heap dump file created [1217555017 bytes in 16.880 secs]
[2019-10-16T07:01:02,385][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [c himeo-docker-single-node] fatal error in thread [elasticsearch[chimeo-docker-sin gle-node][write][T#6]], exiting

2

java.lang.OutOfMemoryError: Java heap space
[2019-10-16T07:01:02,383][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [c himeo-docker-single-node] fatal error in thread [elasticsearch[chimeo-docker-sin gle-node][write][T#8]], exiting
java.lang.OutOfMemoryError: Java heap space
at org.apache.lucene.util.ByteBlockPool$DirectTrackingAllocator.getByteB lock(ByteBlockPool.java:103) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25dd b152501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.util.ByteBlockPool.nextBuffer(ByteBlockPool.java:20 3) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimc zi - 2019-02-04 23:16:28]
at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:268) ~[luce ne-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimczi - 2019 -02-04 23:16:28]
at org.apache.lucene.index.SortedSetDocValuesWriter.addOneValue(SortedSe tDocValuesWriter.java:124) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb1 52501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.SortedSetDocValuesWriter.addValue(SortedSetDo cValuesWriter.java:90) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb15250 1ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.DefaultIndexingChain.indexDocValue(DefaultInd exingChain.java:616) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501a b5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultInde xingChain.java:467) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab 5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]

3

at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultI ndexingChain.java:394) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb15250 1ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(Docum entsWriterPerThread.java:251) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25d db152501ab5bae3ea3d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWrite r.java:494) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3 d5 - jimczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1 616) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - ji mczi - 2019-02-04 23:16:28]
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1235 ) ~[lucene-core-7.7.0.jar:7.7.0 8c831daf4eb41153c25ddb152501ab5bae3ea3d5 - jimcz i - 2019-02-04 23:16:28]
at org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine. java:1164) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(Interna lEngine.java:1109) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.ja va:924) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:824) ~ [elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexSha rd.java:791) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary (IndexShard.java:744) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.lambda$execute IndexRequestOnPrimary$3(TransportShardBulkAction.java:454) ~[elasticsearch-6.7.0 .jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction$$Lambda$3384/0 x0000000801cf4840.get(Unknown Source) ~[?:?]
at org.elasticsearch.action.bulk.TransportShardBulkAction.executeOnPrima ryWhileHandlingMappingUpdates(TransportShardBulkAction.java:477) ~[elasticsearch -6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.executeIndexRe questOnPrimary(TransportShardBulkAction.java:452) ~[elasticsearch-6.7.0.jar:6.7. 0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkIte mRequest(TransportShardBulkAction.java:216) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrima ry(TransportShardBulkAction.java:159) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrima ry(TransportShardBulkAction.java:151) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperation OnPrimary(TransportShardBulkAction.java:139) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperation OnPrimary(TransportShardBulkAction.java:79) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.support.replication.TransportReplicationActi on$PrimaryShardReference.perform(TransportReplicationAction.java:1050) ~[elastic search-6.7.0.jar:6.7.0]
at org.elasticsearch.action.support.replication.TransportReplicationActi on$PrimaryShardReference.perform(TransportReplicationAction.java:1028) ~[elastic search-6.7.0.jar:6.7.0]
at org.elasticsearch.action.support.replication.ReplicationOperation.exe cute(ReplicationOperation.java:105) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.support.replication.TransportReplicationActi on$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.ja va:424) ~[elasticsearch-6.7.0.jar:6.7.0]
at org.elasticsearch.action.support.replication.TransportReplicationActi on$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:370) ~[elas ticsearch-6.7.0.jar:6.7.0]
vmware@vmware:~$

4

cluster.name: "chimeo-docker-cluster"
node.name: "chimeo-docker-single-node"
network.host: 0.0.0.0

http.cors.enabled: true
http.cors.allow-origin: "*"
http.cors.allow-headers: "Authorization"

discovery.zen.ping.unicast.hosts: ["10.0.0.1","10.0.0.2","10.0.0.3"]
network.publish_host: 10.117.4.38

#index.merge.scheduler.max_thread_count: 10
#index.merge.scheduler.max_merge_count: 10

#indices.store.throttle.type: none

5

import requests
import json

payload={
"index_patterns": ["*"],
"settings":{
"index.merge.scheduler.max_thread_count" : "10",
"index.merge.scheduler.max_merge_count" : "10"
#"indices.store.throttle.type" : "none"
}
}

r=requests.put('http://localhost:9200/_template/template_1?pretty', headers={'Content-Type':'application/json'},data=json.dumps(payload))

print(r.text)

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.