hello.
am using Centos 7, kibana 7.6,elasticsearch 7.6.
i have problems with my kibana. It won't start after adding 1 more elasticsearch.host on kibana config. Before that i only have 2 elasticsearch host in my config. and then there is no specify error i can't found in my configuration.
BUT
after i rollback my configuration to deleted the elasticsearch.host. it work well
anyone know what happent?
or can i get reference for it?
here the error from systemctl status kibana
● kibana.service - Kibana
Loaded: loaded (/etc/systemd/system/kibana.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Mon 2020-04-13 22:25:53 WIB; 11h ago
Process: 4798 ExecStart=/usr/share/kibana/bin/kibana -c /etc/kibana/kibana.yml (code=exited, status=1/FAILURE)
Main PID: 4798 (code=exited, status=1/FAILURE)
Apr 13 22:25:50 monitoring systemd[1]: Unit kibana.service entered failed state.
Apr 13 22:25:50 monitoring systemd[1]: kibana.service failed.
Apr 13 22:25:53 monitoring systemd[1]: kibana.service holdoff time over, scheduling restart.
Apr 13 22:25:53 monitoring systemd[1]: Stopped Kibana.
Apr 13 22:25:53 monitoring systemd[1]: start request repeated too quickly for kibana.service
Apr 13 22:25:53 monitoring systemd[1]: Failed to start Kibana.
Apr 13 22:25:53 monitoring systemd[1]: Unit kibana.service entered failed state.
Apr 13 22:25:53 monitoring systemd[1]: kibana.service failed.
there is my kibana.yml
# Kibana is served by a back end server. This setting specifies the port to use.
server.port: 5601
# Specifies the address to which the Kibana server will bind. IP addresses and host names are both valid values.
# The default is 'localhost', which usually means remote machines will not be able to connect.
# To allow connections from remote users, set this parameter to a non-loopback address.
server.host: "monitoring"
# Enables you to specify a path to mount Kibana at if you are running behind a proxy.
# Use the `server.rewriteBasePath` setting to tell Kibana if it should remove the basePath
# from requests it receives, and to prevent a deprecation warning at startup.
# This setting cannot end in a slash.
#server.basePath: ""
# Specifies whether Kibana should rewrite requests that are prefixed with
# `server.basePath` or require that they are rewritten by your reverse proxy.
# This setting was effectively always `false` before Kibana 6.3 and will
# default to `true` starting in Kibana 7.0.
#server.rewriteBasePath: false
# The maximum payload size in bytes for incoming server requests.
#server.maxPayloadBytes: 1048576
# The Kibana server's name. This is used for display purposes.
server.name: "ASDP-MONITORING"
# The URLs of the Elasticsearch instances to use for all your queries.
elasticsearch.hosts: ["http://100.XXX.XXX.XXX:9200", "http://100.XXX.XXX.XXX:9200", "http://100.XXX.XXX.XXX:9200"]
# When this setting's value is true Kibana uses the hostname specified in the server.host
# setting. When the value of this setting is false, Kibana uses the hostname of the host
# that connects to this Kibana instance.
#elasticsearch.preserveHost: true
# Kibana uses an index in Elasticsearch to store saved searches, visualizations and
# dashboards. Kibana creates a new index if the index doesn't already exist.
#kibana.index: ".kibana"
# The default application to load.
#kibana.defaultAppId: "home"
# If your Elasticsearch is protected with basic authentication, these settings provide
# the username and password that the Kibana server uses to perform maintenance on the Kibana
# index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
# is proxied through the Kibana server.
#elasticsearch.username: "kibana"
#elasticsearch.password: "pass"
# Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
# These settings enable SSL for outgoing requests from the Kibana server to the browser.
#server.ssl.enabled: false
#server.ssl.certificate: /path/to/your/server.crt
#server.ssl.key: /path/to/your/server.key
# Optional settings that provide the paths to the PEM-format SSL certificate and key files.
# These files are used to verify the identity of Kibana to Elasticsearch and are required when
# xpack.security.http.ssl.client_authentication in Elasticsearch is set to required.
#elasticsearch.ssl.certificate: /path/to/your/client.crt
#elasticsearch.ssl.key: /path/to/your/client.key
# Optional setting that enables you to specify a path to the PEM file for the certificate
# authority for your Elasticsearch instance.
#elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]
# To disregard the validity of SSL certificates, change this setting's value to 'none'.
#elasticsearch.ssl.verificationMode: full
# Time in milliseconds to wait for Elasticsearch to respond to pings. Defaults to the value of
# the elasticsearch.requestTimeout setting.
#elasticsearch.pingTimeout: 1500
# Time in milliseconds to wait for responses from the back end or Elasticsearch. This value
# must be a positive integer.
#elasticsearch.requestTimeout: 30000
# List of Kibana client-side headers to send to Elasticsearch. To send *no* client-side
# headers, set this value to [] (an empty list).
#elasticsearch.requestHeadersWhitelist: [ authorization ]
# Header names and values that are sent to Elasticsearch. Any custom headers cannot be overwritten
# by client-side headers, regardless of the elasticsearch.requestHeadersWhitelist configuration.
#elasticsearch.customHeaders: {}
# Time in milliseconds for Elasticsearch to wait for responses from shards. Set to 0 to disable.
#elasticsearch.shardTimeout: 30000
# Time in milliseconds to wait for Elasticsearch at Kibana startup before retrying.
#elasticsearch.startupTimeout: 5000
# Logs queries sent to Elasticsearch. Requires logging.verbose set to true.
#elasticsearch.logQueries: false
# Specifies the path where Kibana creates the process ID file.
#pid.file: /var/run/kibana.pid
# Enables you specify a file where Kibana stores log output.
#logging.dest: stdout
# Set the value of this setting to true to suppress all logging output.
#logging.silent: false
# Set the value of this setting to true to suppress all logging output other than error messages.
#logging.quiet: false
# Set the value of this setting to true to log all events, including system usage information
# and all requests.
#logging.verbose: false
# Set the interval in milliseconds to sample system and process performance
# metrics. Minimum is 100ms. Defaults to 5000.
#ops.interval: 5000
# Specifies locale to be used for all localizable strings, dates and number formats.
# Supported languages are the following: English - en , by default , Chinese - zh-CN .
#i18n.locale: "en"
There is the log from Journalctl -fu kibana.service
-- Logs begin at Mon 2020-04-13 18:23:51 WIB. --
Apr 13 22:25:49 monitoring kibana[4798]: FATAL [index_not_found_exception] no such index [.kibana_task_manager], with { resource.type="index_or_alias" & resource.id=".kibana_task_manager" & index_uuid="_na_" & index=".kibana_task_manager" } :: {"path":"/.kibana_task_manager/_count","query":{},"body":"{\"query\":{\"bool\":{\"should\":[{\"bool\":{\"must\":[{\"exists\":{\"field\":\"graph-workspace\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.graph-workspace\":\"7.0.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"space\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.space\":\"6.6.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"map\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.map\":\"7.6.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"canvas-workpad\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.canvas-workpad\":\"7.0.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"task\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.task\":\"7.6.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"index-pattern\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.index-pattern\":\"7.6.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"visualization\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.visualization\":\"7.4.2\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"dashboard\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.dashboard\":\"7.3.0\"}}}}]}},{\"bool\":{\"must\":[{\"exists\":{\"field\":\"search\"}},{\"bool\":{\"must_not\":{\"term\":{\"migrationVersion.search\":\"7.4.0\"}}}}]}}]}}}","statusCode":404,"response":"{\"error\":{\"root_cause\":[{\"type\":\"index_not_found_exception\",\"reason\":\"no such index [.kibana_task_manager]\",\"resource.type\":\"index_or_alias\",\"resource.id\":\".kibana_task_manager\",\"index_uuid\":\"_na_\",\"index\":\".kibana_task_manager\"}],\"type\":\"index_not_found_exception\",\"reason\":\"no such index [.kibana_task_manager]\",\"resource.type\":\"index_or_alias\",\"resource.id\":\".kibana_task_manager\",\"index_uuid\":\"_na_\",\"index\":\".kibana_task_manager\"},\"status\":404}"}
Apr 13 22:25:50 monitoring systemd[1]: kibana.service: main process exited, code=exited, status=1/FAILURE
Apr 13 22:25:50 monitoring systemd[1]: Unit kibana.service entered failed state.
Apr 13 22:25:50 monitoring systemd[1]: kibana.service failed.
Apr 13 22:25:53 monitoring systemd[1]: kibana.service holdoff time over, scheduling restart.
Apr 13 22:25:53 monitoring systemd[1]: Stopped Kibana.
Apr 13 22:25:53 monitoring systemd[1]: start request repeated too quickly for kibana.service
Apr 13 22:25:53 monitoring systemd[1]: Failed to start Kibana.
Apr 13 22:25:53 monitoring systemd[1]: Unit kibana.service entered failed state.
Apr 13 22:25:53 monitoring systemd[1]: kibana.service failed.
`