Upgrading elastic search & kibana from 6.6.1 to 7.x or 8.x

Elastic Stack Elasticsearch
1

Hi @all

This is regarding a query on upgrading Elasticsearch & kibana.
The current version of Elastic search & Kibana in our organization is 6.6.1 used to storing RPA logs.
I am planning to upgrade to 7.x or 8.x

  1. Could you please help me in providing detailed steps to do the upgrade activity for Kibana and Elasticsearch. Are there any prerequisites to directly upgrade to any 7.x or 8.x versions?
  2. Is 7.x and 8.x versions of Elastic search are free or paid versions?
2

From Elastic Search to Elasticsearch

3

These versions are available with a free basic license that you can use.

If you want to get to Elasticsearch 8.X you have 2 options.

  1. Set up a new cluster and reindex all data from the remote 6.6.1 cluster.
  2. Upgrade in place. This will require a number of steps as you can not go directly to the newer version. To get to version 7.17 follow these instructions. In order to get from Elasticsearch 7.17 to the latest 8.x version, follow these instructions.
1 Like
4

@Christian_Dahlqvist Could you elaborate and share detailed steps for task 1 :

  1. Set up a new cluster and reindex all data from the remote 6.6.1 cluster.
5

I do not have any detailed steps for this. If you are new to the stack the other approach may be easier (even if there are a lot more steps) as the upgrade assistant will help you along the way.

6

@Christian_Dahlqvist I am new to this Elastic search and kibana. So i have no idea on how to do the upgrade. could you please provide deep understanding and guide me to complete the upgrade activity.

image
image977×555 33.5 KB

While checking 7.0 Upgrade assistant, i saw the below critical issue :
"Discovery configuration is required in production mode"

Also how to upgrade kibana?

7

Copying here my answer to the same post you opened few hours later:

Hey

The easiest path IMO is to create a new 8.15.0 cluster and reindex the data from the 6.6 cluster.

Otherwise you need to:

  • Upgrade FIRST to 6.8.latest
  • Run the upgrade assistant and fix ALL the issues
  • Upgrade to 7.17.latest
  • Run the upgrade assistant and fix ALL the issues which probably will ask you to rewrite the ol 6.x indices into a 7.17 compatible format
  • Upgrade to 8.15.0
8

@dadoonet
Can you tell me in detail "how to create a new 8.15.0 cluster and reindex the data from the 6.6 cluster."
Also regarding upgrade assistant, i tired to execute the upgrade assistant. But it is showing me some error as in mentioned in my previous comment : " "Discovery configuration is required in production mode".
Could you elaborate on your 4th point as well; How to rewrite the 6.x indices to a 7.17 compatible format?

image
image977×555 33.5 KB

9
  1. Start a new 8.15 cluster
  2. Create the needed index templates
  3. Use Reindex API | Elasticsearch Guide [8.15] | Elastic
10

But did you first upgrade to the latest 6.8?

11

The upgrade assistant in 7.17 will help you for that. But you are not yet there.

12

For a successful upgrade from Elasticsearch 6.6.1 to 7.x or 8.x, setting up a new cluster and reindexing is often the cleanest solution. This approach ensures data integrity and leverages new features without disrupting your existing setup. If you opt for the in-place upgrade, follow the steps carefully, starting with upgrading to 6.8, addressing any issues, and proceeding through the 7.x versions to 8.x. This phased approach will help maintain compatibility and streamline the transition, much like ensuring a smooth transition in package tracking with tools like traceshipments. com.

13

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.