Hi!
I have an error when trying to create kibana.
I am using stable elastic helm charts for creating elasticsearch and kibana (v7.4.0). I have created single-node elasticserach cluster with security enabled (x-pack). I can get a successful response from the cluster if I make it on elasticsearch pod. But my kibana can not connect to the elasticsearch cluster.
My elasticsearch.yml:
cluster.name: "docker-cluster"
network.host: 0.0.0.0
action.destructive_requires_name: true
xpack.license.self_generated.type: basic
xpack.security.enabled: true
xpack.security.authc.realms.file:
users:
order: 0
My kibana.yml
server.name: kibana
server.host: "0"
elasticsearch.hosts: http://elasticsearch-master:9200
elasticsearch.ssl.verificationMode: none
elasticsearch.username: admin
elasticsearch.password: password
kibana logs:
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":["info","plugins-
system"],"pid":6,"message":"Setting up [4] plugins: [security,translations,inspector,data]"}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":
["info","plugins","security"],"pid":6,"message":"Setting up plugin"}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":
["warning","plugins","security","config"],"pid":6,"message":"Generating a random key for
xpack.security.encryptionKey. To prevent sessions from being invalidated on restart, please set
xpack.security.encryptionKey in kibana.yml"}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":
["warning","plugins","security","config"],"pid":6,"message":"Session cookies will be transmitted
over insecure connections. This is not recommended."}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":
["info","plugins","translations"],"pid":6,"message":"Setting up plugin"}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":
["info","plugins","data"],"pid":6,"message":"Setting up plugin"}
{"type":"log","@timestamp":"2020-05-25T19:17:00Z","tags":["info","plugins-
system"],"pid":6,"message":"Starting [3] plugins: [security,translations,data]"}
{"type":"log","@timestamp":"2020-05-25T19:17:37Z","tags":
["status","plugin:kibana@7.4.0","info"],"pid":6,"state":"green","message":"Status changed from
uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-05-25T19:17:37Z","tags":
["status","plugin:elasticsearch@7.4.0","info"],"pid":6,"state":"yellow","message":"Status changed
from uninitialized to yellow - Waiting for
Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-05-25T19:17:38Z","tags":["reporting","browser-
driver","warning"],"pid":6,"message":"Enabling the Chromium sandbox provides an additional
layer of protection."}
{"type":"log","@timestamp":"2020-05-25T19:17:39Z","tags":
["error","elasticsearch","admin"],"pid":6,"message":"Request error, retrying\nHEAD
http://elasticsearch-master:9200/.apm-agent-configuration => connect ECONNREFUSED
172.20.236.184:9200"}
{"type":"log","@timestamp":"2020-05-25T19:17:39Z","tags":
["error","elasticsearch","admin"],"pid":6,"message":"Request error, retrying\nGET
http://elasticsearch-master:9200/_nodes?
filter_path=nodes.*.version%2Cnodes.*.http.publish_address%2Cnodes.*.ip => connect
ECONNREFUSED 172.20.236.184:9200"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
Could not create APM Agent configuration: No Living connections
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:xpack_main@7.4.0","error"],"pid":6,"state":"red","message":"Status changed
from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:graph@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:spaces@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:searchprofiler@7.4.0","error"],"pid":6,"state":"red","message":"Status changed
from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:ml@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from yellow
to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:tilemap@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:watcher@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:40Z","tags":
["status","plugin:elasticsearch@7.4.0","error"],"pid":6,"state":"red","message":"Status changed
from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for
Elasticsearch"}
{"type":"log","@timestamp":"2020-05-25T19:17:41Z","tags":
["error","elasticsearch","data"],"pid":6,"message":"Request error, retrying\nGET
http://elasticsearch-master:9200/_xpack => connect ECONNREFUSED 172.20.236.184:9200"}
{"type":"log","@timestamp":"2020-05-25T19:17:42Z","tags":
["warning","elasticsearch","data"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:42Z","tags":
["warning","elasticsearch","data"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:42Z","tags":
["license","warning","xpack"],"pid":6,"message":"License information from the X-Pack plugin
could not be obtained from Elasticsearch for the [data] cluster. Error: No Living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:43Z","tags":
["reporting","warning"],"pid":6,"message":"Generating a random key for
xpack.reporting.encryptionKey. To prevent pending reports from failing on restart, please set
xpack.reporting.encryptionKey in kibana.yml"}
{"type":"log","@timestamp":"2020-05-25T19:17:43Z","tags":
["status","plugin:reporting@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
uninitialized to red - No Living connections","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-05-25T19:17:43Z","tags":
["status","plugin:security@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from
green to red - No Living connections","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2020-05-25T19:17:44Z","tags":
["warning","elasticsearch","data"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:44Z","tags":
["warning","elasticsearch","data"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:44Z","tags":
["reporting","warning"],"pid":6,"message":"Reporting plugin self-check failed. Please check the
Kibana Reporting settings. Error: No Living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:45Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:45Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:47Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:47Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:49Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:49Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:50Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:50Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
{"type":"log","@timestamp":"2020-05-25T19:17:52Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"Unable to revive connection:
http://elasticsearch-master:9200/"}
{"type":"log","@timestamp":"2020-05-25T19:17:52Z","tags":
["warning","elasticsearch","admin"],"pid":6,"message":"No living connections"}
test request on elasticsearch pod:
curl -u admin:password localhost:9200/_cluster/health?pretty
{
"cluster_name" : "elasticsearch",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 0,
"active_shards" : 0,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 100.0
}
How can this problem solve?
Any idea?