Please help me understand this error message.
I have metricbeat with kafka module running on each of my three kafka cluster nodes
this is my metricbeat.yml file
# =========================== Modules configuration ============================
#setup.ilm.overwrite: true
metricbeat.config.modules:
# Glob pattern for configuration loading
path: ${path.config}/modules.d/*.yml
# Set to true to enable config reloading
reload.enabled: false
# Period on which files under path should be checked for changes
#reload.period: 10s
# ======================= Elasticsearch template setting =======================
setup.template.settings:
index.number_of_shards: 1
index.codec: best_compression
#_source.enabled: false
# ---------------------------- Elasticsearch Output ----------------------------
output.elasticsearch:
# Array of hosts to connect to.
hosts: ["http://*****:9200","http://****:9200","http://*****:9200"]
username: "****"
password: "****"
# ================================= Processors =================================
# Configure processors to enhance or manipulate events generated by the beat.
processors:
- add_host_metadata: ~
- add_cloud_metadata: ~
- add_docker_metadata: ~
- add_kubernetes_metadata: ~
below is my kafka module kafka.yml file. I have one of each on three nodes in my kafka cluster
# Kafka metrics collected using the Kafka protocol
- module: kafka
metricsets:
- partition
- consumergroup
period: 10s
hosts: ["server1***:9092"]
client_id: metricbeat
#retries: 3
#backoff: 250ms
# List of Topics to query metadata for. If empty, all topics will be queried.
#topics: []
# Metrics collected from a Kafka broker using Jolokia
- module: kafka
metricsets:
- broker
period: 10s
hosts: ["server1***:8778"]
when i start up ./metricbeat -e on all three nodes
I see the below error pop up over and over again
2020-12-10T12:26:54.334-0500 ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://****:9200)): Connection marked as failed because the onConnect callback failed: resource 'metricbeat-7.10.0' exists, but it is not an alias
On the Kibana side i have loaded the dashboard that came with the kafka module but some dashboards have the below error
cannot locate index pattern metricbeat-* error
I tried creating the index pattern manually and still i see this error.
i do see an index called metricbeat-7.10.0 and it has some data in it and continues to get some data.
for example i created a new topic and i dont see it reflect on dashboard.
Does the title error message mean, metricbeat is trying to write to metricbeat-7.10.0 and it is not able to even though it exists?
does the index metricbeat-7.10.0 need aliases set?