Index has too many segments

Elastic Stack Elasticsearch
1

Hi, I have an index has too many segments(more than 7000).
When I restore the index from snapshot, segment number is 340(index has 170 shards). After spark-streaming write data to index in few days, the segment number is increase. As shown in the jpg:

toomanysegmengs
toomanysegmengs.jpg2088×1136 883 KB

other info:
es version: 2.3.5
index.refresh_interval: 3s
index size: about 560gb
disk:rotational disk
per shard size: about 1.6gb

Thank you!

2

If you have a slow disk it is quite possible that Elasticsearch segment merging can not keep up if you are indexing heavily. Have you followed the guidelines outlined here?

Given that you are on a very old version I would also recommend upgrading.