Kibana 7.4.2 upgrade is not starting

Just tried to upgrade elasticsearch and kibana from 6.8.5 to 7.4.2.
elasticsearch seems to be running (based on output from curl)

curl -X GET "localhost:9200"
{
"name" : "sjc1upp-logc01",
"cluster_name" : "elasticsearch",
"cluster_uuid" : "na",
"version" : {
"number" : "7.4.2",
"build_flavor" : "default",
"build_type" : "deb",
"build_hash" : "2f90bbf7b93631e52bafb59b3b049cb44ec25e96",
"build_date" : "2019-10-28T20:40:44.881551Z",
"build_snapshot" : false,
"lucene_version" : "8.2.0",
"minimum_wire_compatibility_version" : "6.8.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}

but kibana seems to be in a loop with the following errors:

(log output)
Nov 27 13:46:51 sjc1upp-logc01 systemd[1]: Started Kibana.
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["info","plugins-system"],"pid":17646,"message":"Setting up [4] plugins: [security,translations,inspector,data]"}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["info","plugins","security"],"pid":17646,"message":"Setting up plugin"}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["warning","plugins","security","config"],"pid":17646,"message":"Generating a random key for xpack.security.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.security.encryptionKey in kibana.yml"}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["warning","plugins","security","config"],"pid":17646,"message":"Session cookies will be transmitted over insecure connections. This is not recommended."}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["info","plugins","translations"],"pid":17646,"message":"Setting up plugin"}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["info","plugins","data"],"pid":17646,"message":"Setting up plugin"}
Nov 27 13:46:56 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:46:56Z","tags":["info","plugins-system"],"pid":17646,"message":"Starting [3] plugins: [security,translations,data]"}
Nov 27 13:47:07 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:47:07Z","tags":["status","plugin:kibana@7.4.2","info"],"pid":17646,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
Nov 27 13:47:07 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:47:07Z","tags":["status","plugin:elasticsearch@7.4.2","info"],"pid":17646,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
...
Nov 27 13:47:09 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:47:09Z","tags":["status","plugin:xpack_main@7.4.2","error"],"pid":17646,"state":"red","message":"Status changed from yellow to red - [data] Elasticsearch cluster did not respond with license information.","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
Nov 27 13:47:09 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:47:09Z","tags":["status","plugin:graph@7.4.2","error"],"pid":17646,"state":"red","message":"Status changed from yellow to red - [data] Elasticsearch cluster did not respond with license information.","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
Nov 27 13:47:09 sjc1upp-logc01 kibana[17646]: {"type":"log","@timestamp":"2019-11-27T21:47:09Z","tags":["status","plugin:spaces@7.4.2","error"],"pid":17646,"state":"red","message":"Status changed from yellow to red - [data] Elasticsearch cluster did not respond with license information.","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
..

Kibana proceeds to error with timout and tries to restart...over and over...
can anyone help me with this please? ...

btw I tried this:


but it didn't help...
I only have 1node..

root@sjc1upp-logc01 : Wed Nov 27 : 13:46:07 : ~ : # curl http://localhost:9200/_xpack
{"build":{"hash":"2f90bbf7b93631e52bafb59b3b049cb44ec25e96","date":"2019-10-28T20:40:44.898709Z"},"license":null,"features":{"analytics":{"available":true,"enabled":true},"ccr":{"available":true,"enabled":true},"data_frame":{"available":true,"enabled":true},"flattened":{"available":true,"enabled":true},"frozen_indices":{"available":true,"enabled":true},"graph":{"available":true,"enabled":true},"ilm":{"available":true,"enabled":true},"logstash":{"available":true,"enabled":true},"ml":{"available":true,"enabled":true,"native_code_info":{"version":"7.4.2","build_hash":"473f61b8a5238b"}},"monitoring":{"available":true,"enabled":true},"rollup":{"available":true,"enabled":true},"security":{"available":true,"enabled":false},"spatial":{"available":true,"enabled":true},"sql":{"available":true,"enabled":true},"vectors":{"available":true,"enabled":true},"voting_only":{"available":true,"enabled":true},"watcher":{"available":true,"enabled":true}},"tagline":"You know, for X"}root@sjc1upp-logc01 : Wed Nov 27 : 13:53:29 : ~ : #

all good now ...
turns out the older elasticsearch.yml and kibana.yml files had issues..!

I applied the followin as per https://github.com/elastic/kibana/issues/36079
and fixed my problems! thx

Elasticsearch v7.4.1:

sudo vi /etc/elasticsearch/elasticsearch.yml

  • node.name: node-1
  • discovery.seed_hosts: ["127.0.0.1", "[::1]"]
  • cluster.initial_master_nodes: ["node-1"]

Kibana v7.4.1:

sudo vi /etc/kibana/kibana.yml