Elasticsearch 7.8.1 maximum shards open error

How can I solve this problem?

Env

1. elsticsearch version : 7.8.1
2. cluster
   1) master node 3EA
   2) data Node : 7EA

ConfigFile : elasticsearch.yml

cluster.max_shards_per_node: 10000

Cluster setting

GET /_cluster/settings
{
    "persistent": {
        "cluster": {
            "max_shards_per_node": "10000"
        }
    },
    "transient": {
        "cluster": {
            "max_shards_per_node": "10000"
        }
    }
}

Error Message
[2021-09-15T10:46:16,486][WARN ][logstash.outputs.elasticsearch][main] [01a19182.........]Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"service_log_svc0000028-2021-09", :routing=>nil, :_type=>"_doc"}, #LogStash::Event:0x61706a33], :response=>{"index"=>{"_index"=>"service_log_svc0000028-2021-09", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"illegal_argument_exception", "reason"=>"Validation Failed: 1: this action would add [9] total shards, but this cluster currently has [2999]/[3000] maximum shards open;"}}}}

Welcome to our community! :smiley:

That's a massively bad idea and I'm sorry to say that there's no one here that should be helping you do this.

Why do you think you need to do this?

1 Like

What is the output of:

GET /
GET /_cat/nodes?v
GET /_cat/health?v
GET /_cat/indices?v

If some outputs are too big, please share them on gist.github.com and link them here.