Your index has 7 shards and 1 replica that makes 14 shards to allocate. Since total_shards_per_node is 1, you will need 14 data nodes, you have only 7 data nodes.
i managed to overcome this issue, by assigning "total_shards_per_node" as 3 instead of 2, since I noticed that while the rollover happens, the deletion and creation of replica shard(s) happens in parallel, and so at some point of time, one of the node(s) might have more than 2 shards for the index.
After changing the value to 3, now all the rollover indices are green.
I managed to get to this answer by this
{
"decider" : "awareness",
"decision" : "NO",
"explanation" : "there are too many copies of the shard allocated to nodes with attribute [aws_availability_zone], there are [2] total configured shard copies for this shard id and [3] total attribute values, expected the allocated shard count per attribute [2] to be less than or equal to the upper bound of the required number of shards per attribute [1]"
}
which is a part of the output of the query:
GET /_cluster/allocation/explain
{
"index": "pm2-logs-2020.06.23-000186",
"shard": 6,
"primary": false
}
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.