Metricbeat getting error on illegal_argument_exception: index.lifecycle.rollover_alias

Elastic Stack Beats
1

Hi folks, I keep getting this error on my metricbeat setup, and despite me shutting down and recreate all the index and policies, it will still pop up.

illegal_argument_exception: index.lifecycle.rollover_alias [metricbeat-7.9.2] does not point to index [metricbeat-7.9.2-2020.10.24]

Any workaround ?

2

Hi!

Can you share your Metricbeat config file?

3

Hi Chris,

Here is the config

`
metricbeat.config.modules:
path: ${path.config}/modules.d/*.yml
reload.enabled: false

setup.template.settings:
index.number_of_shards: 1
index.codec: best_compression

setup.kibana:
host: "localhost:5601"

output.elasticsearch:
hosts: ["172.16.1.1:9200"]

processors:

  • add_host_metadata: ~
  • add_cloud_metadata: ~
  • add_docker_metadata: ~
  • add_kubernetes_metadata: ~

monitoring.enabled: true
monitoring.cluster_uuid: 1SHTio1JRw2EEVDzyLhxxx
monitoring.elasticsearch:
hosts: ["https://172.16.1.1:9200", "https://172.16.1.2:9200"]

setup.ilm.overwrite: true
logging.metrics.enabled: false
http.enabled: true
`

4

Hope this helps as well...

Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.890+0800#011INFO#011[publisher_pipeline_output]#011pipeline/output.go:143#011Connecting to backoff(elasticsearch(http://172.16.1.1:9200))
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.890+0800#011INFO#011[publisher]#011pipeline/retry.go:219#011retryer: send unwait signal to consumer
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.890+0800#011INFO#011[publisher]#011pipeline/retry.go:223#011 done
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.893+0800#011INFO#011[esclientleg]#011eslegclient/connection.go:314#011Attempting to connect to Elasticsearch version 7.9.2
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.939+0800#011INFO#011[license]#011licenser/es_callback.go:51#011Elasticsearch license: Basic
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.940+0800#011INFO#011[esclientleg]#011eslegclient/connection.go:314#011Attempting to connect to Elasticsearch version 7.9.2
Oct 28 09:26:56 starlite metricbeat: 2020-10-28T09:26:56.981+0800#011INFO#011[index-management]#011idxmgmt/std.go:261#011Auto ILM enable success.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.036+0800#011INFO#011[index-management]#011idxmgmt/std.go:274#011ILM policy successfully loaded.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.036+0800#011INFO#011[index-management]#011idxmgmt/std.go:407#011Set setup.template.name to '{metricbeat-7.9.2 {now/d}-000001}' as ILM is enabled.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.036+0800#011INFO#011[index-management]#011idxmgmt/std.go:412#011Set setup.template.pattern to 'metricbeat-7.9.2-*' as ILM is enabled.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.036+0800#011INFO#011[index-management]#011idxmgmt/std.go:446#011Set settings.index.lifecycle.rollover_alias in template to {metricbeat-7.9.2 {now/d}-000001} as ILM is enabled.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.036+0800#011INFO#011[index-management]#011idxmgmt/std.go:450#011Set settings.index.lifecycle.name in template to {metricbeat {"policy":{"phases":{"hot":{"actions":{"rollover":{"max_age":"30d","max_size":"50gb"}}}}}}} as ILM is enabled.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.037+0800#011INFO#011template/load.go:89#011Template metricbeat-7.9.2 already exists and will not be overwritten.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.038+0800#011INFO#011[index-management]#011idxmgmt/std.go:298#011Loaded index template.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.038+0800#011INFO#011[index-management]#011idxmgmt/std.go:309#011Write alias successfully generated.
Oct 28 09:26:57 starlite metricbeat: 2020-10-28T09:26:57.039+0800#011INFO#011[publisher_pipeline_output]#011pipeline/output.go:151#011Connection to backoff(elasticsearch(http://172.16.1.1:9200)) established

5

Hey!

It should be the combination of setup.ilm.overwrite: true and setting up the template.
I would suggest either removing ilm if not needed or try to manually define the required settings for template section: https://www.elastic.co/guide/en/beats/metricbeat/current/configuration-template.html

C.

6

Thanks for the advice. Will try that.

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.