Automatic curation of cluster indices

keinproblem · February 21, 2019, 10:32am

Hi,

I would like to automatically evict logs that exceed a specific lifetime in ES.
The Curator provides a delete_indices action in order to realize log eviction in a comfortable fashion.

ECE provides the possibility of setting up curation specs as documented in Update cluster curation settings.
This seems to be only applicable to Hot-Warn deployments, since it will only shift the indices between instances of specified instance configurations.

Is it possible to perform a very similar operation as the delete_indices does with ECE?
If so, how could this be achieved?

Thanks in advance!

theuntergeek · February 21, 2019, 1:43pm

A future release will permit the use of the new Index Lifecycle Management UI in ECE. Until then, you can use Curator to accomplish this in ECE.

keinproblem · February 21, 2019, 2:39pm

Thanks for your input on this, Aaron!

Will the new Index Lifecycle Management UI come with an API extension?

Summarizing:
The ECE API in it's current latest version (2.1.0 when composing this message) does not come with the functionality of managing log deletion.
Running a Curator in the "traditional" way would be required for each ES cluster within ECE, as a possible solution to achieve time based index deletion.

Looking forward into seeing the Index Lifecycle Management UI and API in ECE!

theuntergeek · February 21, 2019, 3:01pm

Yes. Everything ILM will be API-driven. Your summary is accurate.

system · March 7, 2019, 3:01pm

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.