Date Index + Alias question

[beng (Ben)]

We're currently using a date index name pipeline to ingest documents into index based on date (https://www.elastic.co/guide/en/elasticsearch/reference/current/date-index-name-processor.html). We currently have an alias pointed at index-* to support searching across all of our indices.

When the new index index-12-01-2017 was created, the pipeline did not add it to the alias (dumb oversight on my part)... is there a way to have a new index created added to the existing alias?

I found https://stackoverflow.com/questions/37690083/elasticsearch-alias-auto-update-for-rolling-index and tried adding the alias portion to our template, but upon testing it did not add the new index to the existing alias.

[Christian_Dahlqvist]

Which version of Elasticsearch are you on?

[beng (Ben)]

@Christian_Dahlqvist We are currently on 5.6.3

[Christian_Dahlqvist]

In older releases, Kibana used to make a call to the field stats API to identify exactly which indices matching the index pattern that could hold data relevant to the query and then send the query just to these. In recent versions, sending queries to all shards matching an index pattern has been made a lot more efficient, so Kibana no longer performs this extra step.

I am therefore not sure if you really need an alias for all indices that can be read. I would try sending the query directly towards and index pattern that matches what you want to query, e.g. index-*, and see how that performs.

[beng (Ben)]

@Christian_Dahlqvist awesome, thanks for the help!