Hi,
Can anyone help me in getting this error resolved?
[2018-10-08T04:09:29,360][INFO ][o.e.n.Node ] [lmm-elasticsearch-ingest-0] JVM arguments [-Xms10g, -Xmx10g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss10m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.57Q1Wksd, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/heap/dump/path, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config]
2018-10-08T04:09:30.912+0000: Total time for which application threads were stopped: 0.0003064 seconds, Stopping threads took: 0.0001065 seconds
2018-10-08T04:09:31.030+0000: [GC (CMS Initial Mark) To enable GC log rotation, use -Xloggc:<filename> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=<num_of_files>
where num_of_file > 0
GC log rotation is turned off
[1 CMS-initial-mark: 0K(9378240K)] 549378K(10375040K), 0.0340352 secs] [Times: user=0.17 sys=0.00, real=0.04 secs]
Desired survivor size 56688640 bytes, new threshold 1 (max 6)
- age 1: 68553896 bytes, 68553896 total
: 886080K->67078K(996800K), 0.1413758 secs] 886080K->67078K(10375040K), 0.1414290 secs] [Times: user=0.25 sys=0.00, real=0.14 secs]
2018-10-08T04:09:32.059+0000: Total time for which application threads were stopped: 0.1416038 seconds, Stopping threads took: 0.0000628 seconds
2018-10-08T04:09:32.059+0000: [GC (CMS Final Remark) [YG occupancy: 83911 K (996800 K)]2018-10-08T04:09:32.059+0000: [Rescan (parallel) , 0.0825867 secs]2018-10-08T04:09:32.142+0000: [weak refs processing, 0.0000361 secs]2018-10-08T04:09:32.142+0000: [class unloading, 0.0038167 secs]2018-10-08T04:09:32.146+0000: [scrub symbol table, 0.0030758 secs]2018-10-08T04:09:32.149+0000: [scrub string table, 0.0003422 secs][1 CMS-remark: 0K(9378240K)] 83911K(10375040K), 0.0906259 secs] [Times: user=0.33 sys=0.00, real=0.09 secs]
Desired survivor size 56688640 bytes, new threshold 1 (max 6)
- age 1: 105808944 bytes, 105808944 total
: 953158K->110720K(996800K), 0.2960513 secs] 953158K->152236K(10375040K), 0.2961296 secs] [Times: user=0.55 sys=0.02, real=0.29 secs]
2018-10-08T04:09:43.101+0000: Total time for which application threads were stopped: 0.2964850 seconds, Stopping threads took: 0.0001872 seconds
2018-10-08T04:09:43.236+0000: Total time for which application threads were stopped: 0.0055755 seconds, Stopping threads took: 0.0052903 seconds
[2018-10-08T04:09:43,336][INFO ][o.e.c.s.ClusterApplierService] [lmm-elasticsearch-ingest-0] detected_master {lmm-elasticsearch-master-0}{Pd1P4gx0TVGHq8gILQ5OJw}{g41VOXutS4Sb9CEiUPK3Uw}{10.1.26.67}{10.1.26.67:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true}, added {{lmm-elasticsearch-master-1}{vpgEsjtLQvizMmtB-RqDgg}{lCJq-NarQISONs7mtvkBiQ}{10.1.44.102}{10.1.44.102:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-data-1}{6VSfUQ8GST2yF8zZqIjwwA}{89jUESjNRnuVbP7jJprrpA}{10.1.34.87}{10.1.34.87:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-data-4}{TdDXdLPOTLG-Z2KVAXTKsg}{GG02SK2ZQQ-tOHAGbQ1GBw}{10.1.12.62}{10.1.12.62:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-master-2}{MQRg5HvgQ6-7mrxIAZ8gPA}{JEVTUQwdTzW6vAzwgbF-Xg}{10.1.16.43}{10.1.16.43:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-data-3}{WhaAwVG5QwC8wc9PHubAfA}{UEBLhmFnQUCIT_m-Kp11pw}{10.1.28.58}{10.1.28.58:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-ingest-1}{eP8lT5xhTg2czRw_cLpjqg}{BIiLSgRESEi2KDnYArTAyg}{10.1.42.48}{10.1.42.48:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-master-0}{Pd1P4gx0TVGHq8gILQ5OJw}{g41VOXutS4Sb9CEiUPK3Uw}{10.1.26.67}{10.1.26.67:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-data-0}{t4gJgBRJTBqZs3jgs4r3pQ}{OGWNOIiWTNuFJTfDLGQ3mw}{10.1.44.104}{10.1.44.104:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},{lmm-elasticsearch-data-2}{iic3VR5DQSu1mQrc9BFq7g}{YAM0kfmGQWWF0b1b6eUMtg}{10.1.18.31}{10.1.18.31:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true},}, reason: apply cluster state (from master [master {lmm-elasticsearch-master-0}{Pd1P4gx0TVGHq8gILQ5OJw}{g41VOXutS4Sb9CEiUPK3Uw}{10.1.26.67}{10.1.26.67:9300}{ml.machine_memory=67371880448, ml.max_open_jobs=20, ml.enabled=true} committed version [500]])
2018-10-08T04:09:43.356+0000: Total time for which application threads were stopped: 0.0095804 seconds, Stopping threads took: 0.0092086 seconds
[2018-10-08T04:09:43,530][INFO ][o.e.m.j.JvmGcMonitorService] [lmm-elasticsearch-ingest-0] [gc][4] overhead, spent [296ms] collecting in the last [1s]
[2018-10-08T04:09:43,650][INFO ][o.e.l.LicenseService ] [lmm-elasticsearch-ingest-0] license [2980849b-1faa-425e-883b-816f1a329173] mode [trial] - valid
[2018-10-08T04:09:43,660][INFO ][o.e.h.n.Netty4HttpServerTransport] [lmm-elasticsearch-ingest-0] publish_address {10.1.28.56:9200}, bound_addresses {[::]:9200}
[2018-10-08T04:09:43,660][INFO ][o.e.n.Node ] [lmm-elasticsearch-ingest-0] started
CMS: abort preclean due to time 2018-10-08T04:09:43.722+0000: [CMS-concurrent-abortable-preclean: 4.249/5.367 secs] [Times: user=7.09 sys=0.47, real=5.36 secs]
2018-10-08T04:09:43.723+0000: [GC (CMS Final Remark) [YG occupancy: 725644 K (996800 K)]2018-10-08T04:09:43.723+0000: [Rescan (parallel) , 0.0096169 secs]2018-10-08T04:09:43.733+0000: [weak refs processing, 0.0001615 secs]2018-10-08T04:09:43.733+0000: [class unloading, 0.0072790 secs]2018-10-08T04:09:43.740+0000: [scrub symbol table, 0.0073525 secs]2018-10-08T04:09:43.747+0000: [scrub string table, 0.0007101 secs][1 CMS-remark: 41516K(9378240K)] 767160K(10375040K), 0.0265786 secs] [Times: user=0.10 sys=0.00, real=0.03 secs]
2018-07-26T08:31:25.851+0000: [GC (Allocation Failure) 2018-07-26T08:31:25.851+0000: [ParNew
Desired survivor size 17891328 bytes, new threshold 1 (max 6)
- age 1: 28026592 bytes, 28026592 total
: 314144K->28172K(314560K), 0.3048318 secs] 326577K->41099K(1013632K), 0.3048918 secs] [Times: user=0.31 sys=0.01, real=0.31 secs]
Thanks