# CPU High load

**URL:** <https://discuss.elastic.co/t/cpu-high-load/111916>\
**Category:** Elasticsearch\
**Created:** [December 15, 2017, 7:32am UTC](https://discuss.elastic.co/t/cpu-high-load/111916 "2017-12-15T07:32:36Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![sivakaran](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sivakaran](https://discuss.elastic.co/u/sivakaran)\
**Post date:** [December 15, 2017, 7:32am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/1 "2017-12-15T07:32:36Z")

</div>

Hi Team,

I am using **ES-1.3.7(version)** In sometimes it causes very high load on particular node what can we do for this type of issue.

I Checked with **logs** too there is no abnormal logs at all.

Please help on this.Thanks in advance.

::: [NODE\_NAME][NODE\_ID][elasticseasrch][inet[XXX\_\_IP\_\_XXX]]{master=false}

**102.2% (510.8ms out of 500ms) cpu usage by thread 'elasticsearch**[NODE\_NAME][management][T#3]'  
4/10 snapshots sharing following 30 elements  
sun.reflect.Reflection.getCallerClass(Native Method)  
java.lang.Class.getDeclaredFields(Class.java:1805)  
org.apache.lucene.util.RamUsageEstimator.shallowSizeOfInstance(RamUsageEstimator.java:382)  
org.apache.lucene.util.RamUsageEstimator.shallowSizeOf(RamUsageEstimator.java:360)  
org.apache.lucene.util.fst.Outputs.ramBytesUsed(Outputs.java:104)  
org.apache.lucene.util.fst.ByteSequenceOutputs.ramBytesUsed(ByteSequenceOutputs.java:152)  
org.apache.lucene.util.fst.ByteSequenceOutputs.ramBytesUsed(ByteSequenceOutputs.java:34)  
org.apache.lucene.util.fst.FST.ramBytesUsed(FST.java:409)  
org.apache.lucene.util.fst.FST.ramBytesUsed(FST.java:427)102.2% (510.8ms out of 500ms) cpu usage by thread 'elasticsearch[NODE\_NAME][management][T#3]'  
org.apache.lucene.codecs.blocktree.FieldReader.ramBytesUsed(FieldReader.java:187)  
org.apache.lucene.codecs.blocktree.BlockTreeTermsReader.ramBytesUsed(BlockTreeTermsReader.java:308)  
org.elasticsearch.index.codec.postingsformat.BloomFilterPostingsFormat$BloomFilteredFieldsProducer.ramBytesUsed(BloomFilterPostingsFormat.java:201)  
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.ramBytesUsed(PerFieldPostingsFormat.java:238)  
org.apache.lucene.index.SegmentCoreReaders.ramBytesUsed(SegmentCoreReaders.java:226)  
org.apache.lucene.index.SegmentReader.ramBytesUsed(SegmentReader.java:620)  
org.elasticsearch.index.engine.internal.InternalEngine.getReaderRamBytesUsed(InternalEngine.java:1152)  
org.elasticsearch.index.engine.internal.InternalEngine.segmentsStats(InternalEngine.java:1164)  
org.elasticsearch.index.shard.service.InternalIndexShard.segmentStats(InternalIndexShard.java:540)  
org.elasticsearch.action.admin.indices.stats.CommonStats.(CommonStats.java:166)  
org.elasticsearch.action.admin.indices.stats.ShardStats.(ShardStats.java:49)  
org.elasticsearch.indices.InternalIndicesService.stats(InternalIndicesService.java:209)  
org.elasticsearch.node.service.NodeService.stats(NodeService.java:156)  
org.elasticsearch.action.admin.cluster.node.stats.TransportNodesStatsAction.nodeOperation(TransportNodesStatsAction.java:95)  
org.elasticsearch.action.admin.cluster.node.stats.TransportNodesStatsAction.nodeOperation(TransportNodesStatsAction.java:43)  
org.elasticsearch.action.support.nodes.TransportNodesOperationAction$NodeTransportHandler.messageReceived(TransportNodesOperationAction.java:277)  
org.elasticsearch.action.support.nodes.TransportNodesOperationAction$NodeTransportHandler.messageReceived(TransportNodesOperationAction.java:268)  
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
java.lang.Thread.run(Thread.java:745)  
2/10 snapshots sharing following 11 elements  
org.elasticsearch.action.admin.indices.stats.ShardStats.(ShardStats.java:49)  
org.elasticsearch.indices.InternalIndicesService.stats(InternalIndicesService.java:209)  
org.elasticsearch.node.service.NodeService.stats(NodeService.java:156)  
org.elasticsearch.action.admin.cluster.node.stats.TransportNodesStatsAction.nodeOperation(TransportNodesStatsAction.java:95)  
org.elasticsearch.action.admin.cluster.node.stats.TransportNodesStatsAction.nodeOperation(TransportNodesStatsAction.java:43)  
org.elasticsearch.action.support.nodes.TransportNodesOperationAction$NodeTransportHandler.messageReceived(TransportNodesOperationAction.java:277)  
org.elasticsearch.action.support.nodes.TransportNodesOperationAction$NodeTransportHandler.messageReceived(TransportNodesOperationAction.java:268)  
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
java.lang.Thread.run(Thread.java:745)  
4/10 snapshots sharing following 2 elements  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
java.lang.Thread.run(Thread.java:745)

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [December 15, 2017, 7:43am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/2 "2017-12-15T07:43:03Z")

</div>

That is a very old version of Elasticsearch. You should really consider upgrading.

It seems the node is very busy with node management. Do you have a very large number of indices and/or shards in the cluster? Do you have large mappings and/or mappings that are frequently updated dynamically?

---

<div class="post-metadata">

**Author:** ![sivakaran](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sivakaran](https://discuss.elastic.co/u/sivakaran)\
**Post date:** [December 15, 2017, 8:43am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/3 "2017-12-15T08:43:38Z")

</div>

Thanks.

Yes, we are work with **UPGRADATION** So, we do reindex to own index.

Indices: 16  
Shards: 80

No, we disabled the dynamic mapping already.

How can we fix the node management

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [December 15, 2017, 8:51am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/4 "2017-12-15T08:51:27Z")

</div>

Can you provide the full output of the [cluster stats API](https://www.elastic.co/guide/en/elasticsearch/reference/1.3/cluster-stats.html) to give us a better idea about the state of the cluster?

---

<div class="post-metadata">

**Author:** ![sivakaran](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sivakaran](https://discuss.elastic.co/u/sivakaran)\
**Post date:** [December 15, 2017, 8:56am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/5 "2017-12-15T08:56:16Z")

</div>

{  
"timestamp": 1513328024278,  
"cluster\_name": "es",  
"status": "green",  
"indices": {  
"count": 16,  
"shards": {  
"total": 165,  
"primaries": 80,  
"replication": 1.0625,  
"index": {  
"shards": {  
"min": 10,  
"max": 15,  
"avg": 10.3125  
},  
"primaries": {  
"min": 5,  
"max": 5,  
"avg": 5.0  
},  
"replication": {  
"min": 1.0,  
"max": 2.0,  
"avg": 1.0625  
}  
}  
},  
"docs": {  
"count": 163556517,  
"deleted": 21877877  
},  
"store": {  
"size\_in\_bytes": 457061600407,  
"throttle\_time\_in\_millis": 709241  
},  
"fielddata": {  
"memory\_size\_in\_bytes": 2750871813,  
"evictions": 1671603  
},  
"filter\_cache": {  
"memory\_size\_in\_bytes": 1811523164,  
"evictions": 37689953  
},  
"id\_cache": {  
"memory\_size\_in\_bytes": 0  
},  
"completion": {  
"size\_in\_bytes": 0  
},  
"segments": {  
"count": 2043,  
"memory\_in\_bytes": 9052378464,  
"index\_writer\_memory\_in\_bytes": 1384276,  
"version\_map\_memory\_in\_bytes": 680  
},  
"percolate": {  
"total": 1412351,  
"time\_in\_millis": 521584959,  
"current": 0,  
"memory\_size\_in\_bytes": -1,  
"memory\_size": "-1b",  
"queries": 10623  
}  
},  
"nodes": {  
"count": {  
"total": 8,  
"master\_only": 3,  
"data\_only": 5,  
"master\_data": 0,  
"client": 0  
},  
"versions": [  
"1.3.7"  
],  
"os": {  
"available\_processors": 256,  
"mem": {  
"total\_in\_bytes": 2163187679232  
},  
"cpu": [  
{  
"vendor": "Intel",  
"model": "Xeon",  
"mhz": 3000,  
"total\_cores": 32,  
"total\_sockets": 1,  
"cores\_per\_socket": 32,  
"cache\_size\_in\_bytes": 20480,  
"count": 8  
}  
]  
},  
"process": {  
"cpu": {  
"percent": 534  
},  
"open\_file\_descriptors": {  
"min": 846,  
"max": 2690,  
"avg": 1887  
}  
},  
"jvm": {  
"max\_uptime\_in\_millis": 6551538023,  
"versions": [  
{  
"version": "1.7.0\_65",  
"vm\_name": "Java HotSpot(TM) 64-Bit Server VM",  
"vm\_version": "24.65-b04",  
"vm\_vendor": "Oracle Corporation",  
"count": 8  
}  
],  
"mem": {  
"heap\_used\_in\_bytes": 28083885288,  
"heap\_max\_in\_bytes": 46170898432  
},  
"threads": 2985  
},  
"fs": {  
"total\_in\_bytes": 38981224026112,  
"free\_in\_bytes": 18850588155904,  
"available\_in\_bytes": 17080571420672,  
"disk\_reads": 187516718,  
"disk\_writes": 5414807503,  
"disk\_io\_op": 5602324221,  
"disk\_read\_size\_in\_bytes": 11904572949504,  
"disk\_write\_size\_in\_bytes": 147740532974080,  
"disk\_io\_size\_in\_bytes": 159645105923584,  
"disk\_queue": "1.4",  
"disk\_service\_time": "0.1"  
},  
"plugins": [  
{  
"name": "migration",  
"version": "NA",  
"description": "No description found.",  
"url": "/\_plugin/migration/",  
"jvm": false,  
"site": true  
},  
{  
"name": "kopf",  
"version": "1.6.1",  
"description": "kopf - simple web administration tool for ElasticSearch",  
"url": "/\_plugin/kopf/",  
"jvm": false,  
"site": true  
},  
{  
"name": "cloud-aws",  
"version": "2.3.0",  
"description": "Cloud AWS Plugin",  
"jvm": true,  
"site": false  
},  
{  
"name": "head",  
"version": "NA",  
"description": "No description found.",  
"url": "/\_plugin/head/",  
"jvm": false,  
"site": true  
}  
]  
}  
}

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [December 15, 2017, 9:02am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/6 "2017-12-15T09:02:51Z")

</div>

Do you have any non-default configuration in your Elasticsearch configuration?

---

<div class="post-metadata">

**Author:** ![sivakaran](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sivakaran](https://discuss.elastic.co/u/sivakaran)\
**Post date:** [December 15, 2017, 9:20am UTC](https://discuss.elastic.co/t/cpu-high-load/111916/7 "2017-12-15T09:20:41Z")

</div>

we use the default configuration on Elasticsearch.

---

<div class="post-metadata">

**Author:** ![sivakaran](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sivakaran](https://discuss.elastic.co/u/sivakaran)\
**Post date:** [December 21, 2017, 12:44pm UTC](https://discuss.elastic.co/t/cpu-high-load/111916/8 "2017-12-21T12:44:09Z")

</div>

Team, Please help on this.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 18, 2018, 12:44pm UTC](https://discuss.elastic.co/t/cpu-high-load/111916/9 "2018-01-18T12:44:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.