High load (>3.0.0), 60% CPU and 30% heap usage

amackenzie · November 4, 2020, 1:54pm

Hi there,

I'm wondering if someone could help me analyse this hot thread output. We have a number of data nodes. All of these data nodes also ingest and index too. We're using ES 5.6

gist.github.com

https://gist.github.com/alasdairmackenzie/f426f501a327ee06c435627b9da288ed

gistfile1.txt

::: {production-elasticsearch-data1-core}{KpQH7bkyRjaMaZ-1JjC0nA}{aSm-y65eS52ghEvfqh2LUQ}{172.17.137.88}{172.17.137.88:9300}
   Hot threads at 2020-11-04T13:24:14.074Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
   
   100.2% (501.2ms out of 500ms) cpu usage by thread 'elasticsearch[production-elasticsearch-data1-core][warmer][T#1]'
     2/10 snapshots sharing following 18 elements
       org.apache.lucene.index.MultiDocValues$OrdinalMap.<init>(MultiDocValues.java:573)
       org.apache.lucene.index.MultiDocValues$OrdinalMap.build(MultiDocValues.java:511)
       org.apache.lucene.index.MultiDocValues$OrdinalMap.build(MultiDocValues.java:490)
       org.elasticsearch.index.fielddata.ordinals.GlobalOrdinalsBuilder.build(GlobalOrdinalsBuilder.java:65)
       org.elasticsearch.index.fielddata.plain.SortedSetDVOrdinalsIndexFieldData.localGlobalDirect(SortedSetDVOrdinalsIndexFieldData.java:127)

This file has been truncated. show original

Thank you,
Ally

warkolm · November 5, 2020, 3:29am

Welcome to our community!

Can you upgrade your cluster? 5.X is EOL.

amackenzie · November 9, 2020, 10:00am

Thank you! We will be upgrading in the next 6 months but it's a lot easier to get It roadmapped sooner if it'll definitely improve things. Do you reckon that'll help?

warkolm · November 9, 2020, 8:47pm

It's not really clear what problem you have here?
If Elasticsearch is only using 30% heap, that seems pretty good to me, even with CPU a little higher.

system · December 7, 2020, 8:47pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.