Kibana not starting after 7.6 Upgrade

[rluzardo (Raul J Luzardo)]

Hello, I just did an upgrade from Kibana 7.3 to 7.6. After installing with the RPM and using the same kibana.yml file I had before, I tried to start the service and after 3 restarts I got the following error

journalctl -fu kibana.service
-- Logs begin at Tue 2020-02-25 18:58:29 UTC. --
Feb 25 20:54:39 elkkibsus1202 kibana[3306]: FATAL Error: Index .kibana_task_manager belongs to a version of Kibana that cannot be automatically migrated. Reset it or use the X-Pack upgrade assistant.
Feb 25 20:54:40 elkkibsus1202 systemd[1]: kibana.service: Main process exited, code=exited, status=1/FAILURE
Feb 25 20:54:40 elkkibsus1202 systemd[1]: kibana.service: Unit entered failed state.
Feb 25 20:54:40 elkkibsus1202 systemd[1]: kibana.service: Failed with result 'exit-code'.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: kibana.service: Service RestartSec=3s expired, scheduling restart.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: Stopped Kibana.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: kibana.service: Start request repeated too quickly.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: Failed to start Kibana.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: kibana.service: Unit entered failed state.
Feb 25 20:54:43 elkkibsus1202 systemd[1]: kibana.service: Failed with result 'start-limit'.

I've been looking to the Fatal Error but can't find anything that helps.

Thanks in advance.

[joshdover]

@rluzardo

cannot be automatically migrated

It looks like you may need to reset the task manager index. You can do this by executing this curl against your Elasticsearch cluster: curl http://myelasticsearch.com:9200/.kibana_task_manager -XDELETE

[rluzardo (Raul J Luzardo)]

Thanks josh, I already did this on my two elasticsearch nodes and I am still having the same problem

I don't even have a kibana_task_manager any more:

ccloud@elkkibsus1202:~> curl -XGET 'MYIP:9200/_cat/indices?v&pretty' | grep kib
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2540 100 2540 0 0 95449 0 --:--:-- --:--:-- --:--:-- 97692
yellow open .monitoring-kibana-7-2020.02.23 maDM_2bkQAy_cZlwxapUkQ 1 1 8639 0 2.2mb 2.2mb
yellow open .monitoring-kibana-7-2020.02.22 h8OmeCczSEay6c2kt_homg 1 1 8640 0 2.2mb 2.2mb
yellow open .monitoring-kibana-7-2020.02.21 qblEPBClTMq561ctaFAkRA 1 1 8639 0 2.2mb 2.2mb
yellow open .monitoring-kibana-7-2020.02.20 O5mz8xhsQaGz2XDMitknAA 1 1 8639 0 2.2mb 2.2mb
yellow open .monitoring-kibana-7-2020.02.25 G0OCoNsrSvOvfCEQGC-C5A 1 1 6500 0 1.8mb 1.8mb
yellow open .monitoring-kibana-7-2020.02.24 BklDVk-QT9uUQsobaewE2w 1 1 8636 0 2.4mb 2.4mb
yellow open .kibana_1 wSO5y3EvQY6254E3B8chDA 1 1 0 0 283b 283b
yellow open .monitoring-kibana-7-2020.02.19 1tE3OV23SW6wp75NZqEwFw 1 1 8639 0 2.2mb 2.2mb

[joshdover]

What logs are you getting when you start Kibana?

[rluzardo (Raul J Luzardo)]

Hey Josh, don't know what I did different but it came up. Thanks for the help