We saw a ~45 minute IO spike in our elastic search nodes today, and during that time, we had no spike in indexing or querying. The only thing we can guess happened was a rebalance. Is there any way we can confirm this theory for sure? What else might cause this spike if our idexing/querying nodes were spiking?
One other reason for a spike in IO is large merge that happened to a lucene
index. Each lucen index is constructed of several segments, which gets
merged every so ofter (I can provide more details on how this works if
needed). A spike might be caused because a large merge between big segments
has occurred.
We saw a ~45 minute IO spike in our elastic search nodes today, and during
that time, we had no spike in indexing or querying. The only thing we can
guess happened was a rebalance. Is there any way we can confirm this
theory
for sure? What else might cause this spike if our idexing/querying nodes
were spiking?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.