Reclaim deleted documents memory in Elasticsearch

Elastic Stack Elasticsearch
1

Hi,

We have a situation that we are getting some error documents(grokparsefailure) in elasticsearch from logstash. I have deleted all those documents which are around 2million out of 90days data. This is going to be regular process with only few thousands of docs. Now I am wondering, its already more than few days but I still can not see memory is reclaimed. I have added "indices.store.throttle.max_bytes_per_sec" : "100mb" to cluster but no use. I have already tried forcemerge on 1month data and didn't try that on another 2months data. I understand that segments should merge so that deleted documents memory will be reclaimed. But When it will happen. Could you please anybody help me in this as we want to see reclaimed memory as early as possible. Thanks.
ES:5.2.1
Logstash:5.2.1
Kibana:5.2.1

2

It's not memory that it uses, it's disk. Merges happen automatically but you can call a force merge too.

Applying that setting has nothing to do with what you want though.

3

Thanks @warkolm for the quick response. My intention is to disk size only. I have tried force merge on one month data. But I would like to know more about that automatic process like configuring any settings. May I know, is there any chance we can expedite that automatic merging. Thanks.

4

Merges happen automatically but you can call a force merge too.

As per above these are your best options.

5

Thanks @warkolm for the quick help :slight_smile:

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.