Filebeat and Metricbeats setup fails with Elasticsearch and Kibana 7.0 -Failed to import dashboard: Failed to load directory


(Brad) #1

Running sudo metricbeat setup and sudo filebeat setup and get the following error belows.

root@ubuntu-s-1vcpu-2gb-sfo2-01:/etc/metricbeat/modules.d# sudo metricbeat setup
Index setup complete.
Loading dashboards (Kibana must be running and reachable)

Exiting: Failed to import dashboard: Failed to load directory /usr/share/metricbeat/kibana/7/dashboard:
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-golang-overview.json: returned 400 to import file: . Response: {"statusCode":400,"error":"Bad Request","message":"[parent] Data too large, data for [<http_request>] would be [1026768160/979.2mb], which is larger than the limit of [1020054732/972.7mb], real usage: [1026750736/979.1mb], new bytes reserved: [17424/17kb]: [circuit_breaking_exception] [parent] Data too large, data for [<http_request>] would be [1026768160/979.2mb], which is larger than the limit of [1020054732/972.7mb], real usage: [1026750736/979.1mb], new bytes reserved: [17424/17kb], with { bytes_wanted=1026768160 & bytes_limit=1020054732 & durability="PERMANENT" }"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-backend.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-frontend.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-http-backend.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-http-frontend.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-http-server.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-haproxy-visualizations.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-host-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-kafka-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-kubernetes-apiserver.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-mongodb-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-mssql-performance.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-mssql-transaction_log.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-mysql-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-nats-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-rabbitmq-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-redis-keys.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-redis-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-system-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-uwsgi-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/Metricbeat-zookeeper-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/metricbeat-nginx-overview.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}
error loading /usr/share/metricbeat/kibana/7/dashboard/metricbeat-windows-service.json: returned 401 to import file: . Response: {"statusCode":401,"error":"Unauthorized","message":"Unauthorized"}

root@ubuntu-s-1vcpu-2gb-sfo2-01:/etc/metricbeat/modules.d# sudo filebeat setup
Exiting: Couldn't connect to any of the configured Elasticsearch hosts. Errors: [Error connection to Elasticsearch http://159.65.99.121:9200: Connection marked as failed because the onConnect callback failed: cannot retrieve the elasticsearch license: error from server, response code: 429]

root@ubuntu-s-1vcpu-2gb-sfo2-01:/etc/metricbeat/modules.d# sudo filebeat setup
Exiting: Couldn't connect to any of the configured Elasticsearch hosts. Errors: [Error connection to Elasticsearch http://159.65.99.121:9200: Connection marked as failed because the onConnect callback failed: cannot retrieve the elasticsearch license: error from server, response code: 429]


(Jaime Soriano) #2

Hi @bradfordaemorton,

This error indicates that metricbeat is failing to authenticate, you may need to setup and user and a password in the configuration with the options setup.kibana.username and setup.kibana.password.

The error with filebeat indicates some problem to connect, could you try to make a request with curl? e.g. curl http://159.65.99.121:9200.


(Brad) #3

Thanks Jaime,

I had to rebuild the server and the error doesn't happen anymore. Not sure what the issue was not.

Cheers,
Brad