Also a previous question: Does ILM work in Logstash with custom index names?
And the issue I raised as the ilm_pattern => "000001" didn't work either:
output {
elasticsearch{
hosts => "${ELASTICSEARCH_HOST}:${ELASTICSEARCH_PORT}"
index => "%{[@metadata][kafka][topic]}-%{+YYYY.MM.dd}"
# ilm_rollover_alias => "%{[@metadata][kafka][topic]}"
# ilm_policy => "%{[@metadata][kafka][topic]}"
ilm_pattern => "000001"
}
}
I opened an issue here: https://github.com/elastic/logstash/issues/12214
I saw that @warkolm was addressing a similar question here: How to correct custom logstash index name for use by ILM