# Shards not distributed amongst nodes

**URL:** <https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481>\
**Category:** Elasticsearch\
**Created:** [December 17, 2015, 3:01pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481 "2015-12-17T15:01:42Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![yehosef](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yehosef/32/42175_2.png) [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Post date:** [December 17, 2015, 3:01pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/1 "2015-12-17T15:01:42Z")

</div>

We have an ES cluster - started with 3 machines and we recently added 2 more. We are processing user aggregation data. We had an index called users-v6 and when we added the new machines it distributed across them. We wanted to rerun the aggregations so we wrote to a new index - users-v7.

The interesting part is that the v7 is only running on the initial machines and is not putting shards/replicas on the the other nodes.

Any ideas why and how I can fix this?

 ![](https://us1.discourse-cdn.com/elastic/original/2X/5/5e35bbae1816447c148d3a0b3fd45765da689826.png)

---

<div class="post-metadata">

**Author:** ![jimczi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jimczi/32/47985_2.png) [@jimczi](https://discuss.elastic.co/u/jimczi)\
**Post date:** [December 17, 2015, 3:27pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/2 "2015-12-17T15:27:26Z")

</div>

What's the spec of the new machine ? Same as the old one ? Did you check the disk space on the new machines ?

---

<div class="post-metadata">

**Author:** ![yehosef](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yehosef/32/42175_2.png) [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Post date:** [December 17, 2015, 3:40pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/3 "2015-12-17T15:40:04Z")

</div>

The machines are supposed to be the same - though the new machines have more cores/cpus (I'm not sure if they hyperthreading, etc.. new have 4 CPUs in htop, new have 16 CPUs). The old machines have about 1TB SSD and the new about 700GB. All have 32 GB RAM, heap set to 16GB.

 ![](https://us1.discourse-cdn.com/elastic/original/2X/a/ac04b2964509595bf192ed2a979e91110befdc9b.png)

We're doing about 20k inserts/updates a second during this screenshot.

---

<div class="post-metadata">

**Author:** ![jimczi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jimczi/32/47985_2.png) [@jimczi](https://discuss.elastic.co/u/jimczi)\
**Post date:** [December 17, 2015, 4:31pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/4 "2015-12-17T16:31:22Z")

</div>

Can you share your settings ? Did you change the default settings of the "cluster.routing.allocation.balance.shard.\*" ? You can check this page [https://www.elastic.co/guide/en/elasticsearch/reference/current/shards-allocation.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/shards-allocation.html) if you want to understand how the allocation is done.

---

<div class="post-metadata">

**Author:** ![yehosef](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yehosef/32/42175_2.png) [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Post date:** [December 17, 2015, 4:45pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/5 "2015-12-17T16:45:39Z")

</div>

Do you mean this?

```
GET users-v6,users-v7/_settings
{
   "users-v6": {
      "settings": {
         "index": {
            "creation_date": "1449646264318",
            "number_of_shards": "3",
            "number_of_replicas": "1",
            "version": {
               "created": "1070199"
            },
            "uuid": "gCIErd5SQhKZSUzGAxwH6g"
         }
      }
   },
   "users-v7": {
      "settings": {
         "index": {
            "creation_date": "1450350011145",
            "number_of_shards": "3",
            "number_of_replicas": "1",
            "version": {
               "created": "1070199"
            },
            "uuid": "SwmtHce2RFCHysL2SAGTKA"
         }
      }
   }
}

```

I don't think I've change those setting (through I was looking into to handle migrating data off nodes that are going to be removed.

Is there some where else I should look?

---

<div class="post-metadata">

**Author:** ![yehosef](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yehosef/32/42175_2.png) [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Post date:** [December 17, 2015, 4:49pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/6 "2015-12-17T16:49:27Z")

</div>

There is also

```
GET _cluster/settings
{
    "persistent": {
        "indices": {
            "store": {
                "throttle": {
                    "type": "merge",
                    "max_bytes_per_sec": "100mb"
                }
            }
        }
    },
    "transient": {
        "indices": {
            "cache": {
                "filter": {
                    "size": "1gb"
                }
            },
            "recovery": {
                "concurrent_streams": "5"
            }
        }
    }
}
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:30pm UTC](https://discuss.elastic.co/t/shards-not-distributed-amongst-nodes/37481/7 "2017-07-05T23:30:07Z")

</div>