Balancing indexes by priority

Elastic Stack Elasticsearch
1

Very often, we get so that all new indices converge on one node and the node starts to reject.
Now we use ILM and each index is given a priority.
I want to configure so that indexes with equal priority are placed evenly across all servers.

For example now:
This is the number of indexes of the same priority that are written to for each server.

    343 ess04
    353 ess07
    527 ess02
    531 ess03
    568 ess06

This is the number of indexes of the same priority that are written to for each node.

    165 ess02-1
    168 ess04-2
    170 ess07-3
    172 ess06-3
    174 ess02-3
    175 ess03-1
    175 ess04-3
    178 ess03-2
    178 ess03-3
    183 ess07-1
    188 ess02-2
    188 ess06-2
    208 ess06-1

distribution of all indices

415 ess06-3
415 ess03-2
415 ess03-3
415 ess06-1
415 ess07-3
416 ess07-1
416 ess06-2
415 ess04-3
415 ess03-1
416 ess02-3
416 ess04-2
415 ess02-2
415 ess02-1

As you can see, balancing does not work well in this regard. And the ess06 server is now under increased load. How can I fix the situation?

2

If you are referring to index.priority this relates to recovery only, as per the docs. Elasticsearch balances indices based on the shard count on each node, followed by how much disk space the nodes have.

Are you using tiering with ILM?

3

I just don't know how else to find the indexes that are currently being logged when using data-stream, I have the highest index.priority in the hot phase, after the rollover the warm phase immediately follows.
All nodes have the same roles. The task is to distribute all the indexes in which the record is made evenly throughout the cluster.

4

What's the solution you are trying to reach here?

5

I want to know how people do balancing, I thought the developers could tell me how to solve this problem.
Maybe someone has already encountered this problem and solved it.

6

Your last lot of numbers show that the node you are concerned about has pretty much the same number of shards as all the other nodes, that is how Elasticsearch balances things.

Are you seeing all shards for a new index being allocated on a single node?

7

How many indices are you actively indexing into? How many indices do you have in total? How many primary shards do these have?

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.