OOME When large segments merge

Elastic Stack Elasticsearch
#1

I've noticed periodically that data nodes in my cluster will run out of
heap space when large segments start merging. I attached a screenshot of
what marvel looked like leading up to the OOME on one of my data nodes.

My question is, generally speaking, what knobs should I be turning to
throttle resource consumption when large segment files are being merged?

I'm running ES version 1.4.1.

Thanks,
Mark

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/35f2c096-ee1e-4a30-a11c-0177e84356ff%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

#2

Do you have many fields with norms enabled?

Mike McCandless

http://www.elastic.co

On Thu, Mar 12, 2015 at 1:20 PM, Mark Greene mark@evertrue.com wrote:

I've noticed periodically that data nodes in my cluster will run out of
heap space when large segments start merging. I attached a screenshot of
what marvel looked like leading up to the OOME on one of my data nodes.

My question is, generally speaking, what knobs should I be turning to
throttle resource consumption when large segment files are being merged?

I'm running ES version 1.4.1.

Thanks,
Mark

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/35f2c096-ee1e-4a30-a11c-0177e84356ff%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/35f2c096-ee1e-4a30-a11c-0177e84356ff%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKHUQPi4_NZdB_0xZ1-13ke2qJOUr%3DuH9BUzHTj5Em0GWJ3uNg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

#3