High Heap Usage

We are using single node of elasticsearch v7.9.1 with 3.0 Tb of data. The rollover size is 10 gb 3 shards per index, that makes in 3.33 gb per shard.
I need help troubleshooting these issues:

  • The heap usage is always around 85%, though the heap size is 20gigs.
  • We are constantly getting Data too large exception, when indexing more data.

My guess is the rollover size is too small which is creating too many small shards and causing high heap usage and thats tripping the circuit breaker

Please Advice

Thanks and Regrads

Welcome to our community! :smiley:

That's pretty inefficient. I would suggest you increase that and shrink some of your indices.

Thanks for replaying, any suggestion what max_size should i use for rollover?

We normally suggest in the range of 30-50GB.

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.