Does a _forcemerge?max_num_segments=1 request fail when the segment reaches 500GB. Or would the request create a second segment?
We punt on recovery time in favor of 100GB shards for better search performance. This is a time-series one-index per day use case. We want to reduce the number of segments when the index no longer needs to accept new documents. Our cluster has 6 data nodes; 6 pri, 1 repl per daily index. It indexes about 900M documents (300GB) per day. We are getting gateway errors from Kibana with 7-day search.