Hi, I have an index has too many segments(more than 7000).
When I restore the index from snapshot, segment number is 340(index has 170 shards). After spark-streaming write data to index in few days, the segment number is increase. As shown in the jpg:
If you have a slow disk it is quite possible that Elasticsearch segment merging can not keep up if you are indexing heavily. Have you followed the guidelines outlined here?
Given that you are on a very old version I would also recommend upgrading.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.