Hi guys. I was very happy playing with my filebeat / netflow platform untill today. There was nothing to see and founded following message at log file: high disk watermark [90%] exceeded on [NX79WFORStGfAdCq26XLaw][ubuntu-elk][/var/lib/elasticsearch/nodes/0] free: 11.8gb[8.1%], shards will be rel…

One other thing I do when I have a small POC cluster I also update the ILM policy to make each index 10GB that way you can clean up smaller chunks PUT /_ilm/policy/metricbeat { "policy" : { "phases" : { "hot" : { "min_age" : "0ms", "actions" : { "ro…

Hey Leandro, sounds like you're looking for the index lifecycle management. https://www.elastic.co/guide/en/elasticsearch/reference/current/index-lifecycle-management.html Here you can automate the four phases of the index lifecycle (hot, warm, cold and delete). You have a lot of options to choos…

Hi @leostereo Welcome to running a cluster So 1 thing after you exceed the watermark, elasticsearch protects itself by going to read only mode. After you clean out some space you need to put the indices back into write mode. Note not meant for production but you can run this command after you de…

Ok ... I managed to create my policy. I created following for my filebeats indices: { "filebeat" : { "version" : 2, "modified_date" : "2020-09-04T16:46:46.668Z", "policy" : { "phases" : { "hot" : { "min_age" : "0ms", "actions" : { "rollo…

I think you are missing or at least I can not see what the next phase is... did you create a delete phase? otherwise it is just going to continue to grow / accumulate

You were right ... A delete phase was missing. My disk was full filled again. I already modified the policy ... lets see what happend in two days. "filebeat" : { "version" : 3, "modified_date" : "2020-09-07T12:13:34.972Z", "policy" : { "phases" : { "hot" : { …

How to properly delete index?

Elastic Stack Elasticsearch

stephenb (Stephen Brown) September 7, 2020, 2:54pm 8

@leostereo

I don't think you need the delete_searchable_snapshot action since you did not create one as part of the lifecycle ...

See example here

Topic		Replies	Views
Configure Delete indices based on size index lifecycle management Policy Elastic search Elasticsearch ilm-index-lifecycle-management	8	2437	August 18, 2020
Delete Index and How to free up disk space Elasticsearch	8	23007	September 13, 2017
Clean old indexes automatically in elasticsearch Kibana	5	4540	January 20, 2023
Force-deleting index that is being snapshotted Elasticsearch	0	2133	October 16, 2017
Limpeza de index Elastic em Português - Brasil	18	5720	March 17, 2022

How to properly delete index?

Related topics