I am using Logstash to ingest log data to Elasticsearch, Indices are created daily, that every day's index has a unique name like index_name-YYYY-MM-DD . So, after 30 days, there will be 30 indices. On day 31st, I want the index made at day 1 to get deleted, and on 32nd day, I want 2nd day's index to get deleted.
I had a look at Index Lifecycle Policies. It is showing option through curl but is there any way to do through logtash conf file?
Then I would recommend opening a separate thread to solve that issue rather than dismiss ILM. When you do so, make sure you share the full policy as well as node configurations and version information.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.