Anyone know how to query the actuel index_buffer_size?
I have searched thru the _cluster/stats output, but cannot find it.
Using 3-node ES 1.0.1 for a logsearch platform (lots of logstash bulking,
less kibana querying) with fresh indices every day, I have
indices.memory.index_buffer_size=50% for a total heap of 32GB.
I have a believe 50% is far too high, but cannot find a metric to prove
this.
You can not measure the actual index_buffer_size by API. It is a dynamic
setting, ES adapts its size regularly in the background, depending on
indexing activity. The number is a maximum estimated value. 50% is a good
value for bulk indexing in comparison to the default 10%. It means,
indexing service is allowed to allocate up to 50% of the available heap
memory of a node for buffering data (mostly large docs). Note, it does not
mean that always 50% of all the heap memory is reserved and not available
any more for other components. It is just a high water mark for the
indexing service, just one step in the whole indexing process. There are
more knobs that are also important for bulk indexing performance.
Anyone know how to query the actuel index_buffer_size?
I have searched thru the _cluster/stats output, but cannot find it.
Using 3-node ES 1.0.1 for a logsearch platform (lots of logstash bulking,
less kibana querying) with fresh indices every day, I have
indices.memory.index_buffer_size=50% for a total heap of 32GB.
I have a believe 50% is far too high, but cannot find a metric to prove
this.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.