How to shrink an index spread over multiple nodes

Elastic Stack Elasticsearch
1

Hey Team,

How do i go about shrinking an index, which has shards over multiple nodes ?
I keep getting this error

{
  "error": {
    "root_cause": [
      {
        "type": "remote_transport_exception",
        "reason": "[pronto-g3-1577817661-3-1463179-pronto][10.174.157.164:9300][indices:admin/resize]"
      }
    ],
    "type": "illegal_state_exception",
    "reason": "index time_logs_data_2020_06_16 must have all shards allocated on the same node to shrink index"
  },
  "status": 500
}

I would also like to explore if there's any way of enforcing future indices to be created on the same node, so i can shrink them later on when they become read only. Thanks in advance!

2

Before you can shrink an index:

  • The index must be read-only.
  • A copy of every shard in the index must reside on the same node.
  • The cluster health status must be green.

Check out this part of ILM.

3

Wonder why cluster has to be green ... makes sense for index to be green, I guess - though what about replicas? Ah, says the node only needs a copy of each shard, not all the shards (can be some replicas, though hard to do that in practice).

Note that doc is really not right as says the API call "three conditions can be achieved" - but one condition is green cluster; pretty sure no API call can make a cluster green :wink:

4

You'd normally drop the replica set before reallocating the shards, shrinking, then add them back.

5

Makes sense; surprised not mentioned in that somewhat confusing doc page.

6

I would encourage you to raise a docs issue on GitHub to get it added if you'd like to see it there.

1 Like
7

Thanks - is there a link/dock on best way to do that; seen the awesome Github doc repo, but not sure how to raise issue on specific page (vs. the 'project').

8

The docs are part of each product, so raise a feature request - https://github.com/elastic/elasticsearch/issues/new/choose

1 Like
9

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.