ELK 7 The request for this panel failed

[teamg]

I have an ELK 6.7 and an ELK 7 both on single nodes. They're configured the same with metricbeat installed to monitor the nodes. When I look at the Host Overview Dashboard on ELK 7 I see:

This does not occur on the ELK 6.7 node. Are there any changes between version which would cause this?

[Chernomazov]

https://www.elastic.co/guide/en/elasticsearch/reference/current/fielddata.html
Elasticsearch 7.0 uses keyword field for aggregation of fields with text type.

You need to upgrade Metricbeat to 7.0 version: https://www.elastic.co/guide/en/beats/libbeat/7.0/upgrading-6-to-7.html

[teamg]

Metricbeat is at version 7:

[root@elk ~]# rpm -qa|grep metric
metricbeat-7.0.0-1.x86_64

[Chernomazov]

Is Elasticsearch index template for Metricbeat upgraded?
Are Kibana dashboards for Metrcibeat upgraded?

[teamg]

This is a fresh install of ELK 7 across the board, Elastic, Logstash, Kibana, Metricbeat.

[ruflin]

Do you send the data through LS? Did you load the index template? What is the versioning scheme you use for the indices?

[teamg]

Yes, my data is going through ES. Below is my metricbeat.yml:

[root@elk metricbeat]# cat metricbeat.yml |grep -v #|grep -v -e '^$'

> metricbeat.config.modules:
>   path: ${path.config}/conf.d/*.yml
>   reload.period: 10s
>   reload.enabled: false
> metricbeat.max_start_delay: 10s
> metricbeat.modules:
> - module: system
>   metricsets:
>   enabled: true
>   period: 10s
>   processes: ['.*']
> output.elasticsearch:
>   enabled: true
>   hosts: ["localhost:9200"]
> setup.dashboards.enabled: true
> setup.dashboards.directory: ${path.home}/kibana
> setup.template.enabled: true
> setup.template.name: "metricbeat-%{[beat.version]}"
> setup.template.pattern: "metricbeat-%{[beat.version]}-*"
> setup.template.fields: "${path.config}/fields.yml"
> setup.template.settings:
> setup.kibana:
> logging.to_files: true
> logging.files:

[ruflin]

What is the reason you have setup template in there? In general I would not recommend to modify the defaults (it looks like the defaults?) if not needed. With 7.0 Beats start to use ILM by default.

[teamg]

I changed setup.template.enabled to false and restarted metricbeat. I deleted the metricbeat index to get a fresh start but I still see the same errors. Not sure what I'm missing here.

metricbeat.config.modules:
path: ${path.config}/conf.d/*.yml
reload.period: 10s
reload.enabled: false
metricbeat.max_start_delay: 10s
metricbeat.modules:

• module: system
  metricsets:
  enabled: true
  period: 10s
  processes: ['.']
  output.elasticsearch:
  enabled: true
  hosts: ["localhost:9200"]
  setup.template.enabled: false
  setup.template.name: "metricbeat-%{[beat.version]}"
  setup.template.pattern: "metricbeat-%{[beat.version]}-"
  setup.template.fields: "${path.config}/fields.yml"
  setup.template.settings:
  setup.kibana:
  logging.to_files: true
  logging.files: