Phase out VM from cluster

Elastic Stack Elasticsearch
1

Hi,
I have an issue where one of my hot nodes has a larger disk than needed. Since I can't downsize the disk and due to the volume of data, I can't simply copy over to a smaller disk.
So I thought it'd be the easiest (not the cheapest) way to:

  1. Exclude the VM from shard allocation. (doc)
  2. Move the shards away to other nodes, and let ES figure out the balancing.

However, I have over 200 shards, and each shard is between 40-50GB, and it looks really tedious to do it manually. Is there a way to make this faster or automate the process without writing a script?

Thank you!

2

You won't need to move anything manually, as soon as you exclude the node from shard allocation elasticsearch will start moving the shards out of this node to other nodes on the cluster.

But depending on the number and size of the shards this can take some time.

1 Like
3

Ah, I see. Thank you @leandrojmp That's good to know!
Since I have the cluster in one DC with great resources & bandwidth, what settings can I change to max out the rebalancing operation speed and concurrency?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.