# Cluster settings from elasticsearch.yml are not working

**URL:** <https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650>\
**Category:** Elasticsearch\
**Created:** [May 13, 2015, 8:47pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650 "2015-05-13T20:47:25Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![emptyemail](https://avatars.discourse-cdn.com/v4/letter/e/6de8d8/32.png) [@emptyemail](https://discuss.elastic.co/u/emptyemail)\
**Post date:** [May 13, 2015, 8:47pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/1 "2015-05-13T20:47:25Z")

</div>

Hi, I could be doing something wrong. But for some reason the following properties in elasticsearch.yml are not applying to a new cluster.

```auto
threadpool.bulk.queue_size : 500
routing.allocation.awareness.attributes: rack,zone
routing.allocation.node_concurrent_recoveries: 5

```

I've also tried to prefix the with `cluster.`

I am able to set those properties via the api on a live cluster. But would like to be able to have defaults for new clusters that start up.

To view the properties I am using /cluster/\_settings and getting back

```auto
{"persistent":{},"transient":{}}

```

Am I missing something?

Thanks!

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 13, 2015, 9:49pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/2 "2015-05-13T21:49:36Z")

</div>

Per [the docs](http://www.elastic.co/guide/en/elasticsearch/reference/current/modules-cluster.html), it's;

```
cluster.routing.allocation.awareness.attributes
cluster.routing.allocation.node_concurrent_recoveries

```

Are you also setting these two on your nodes;

```
node.rack
node.zone
```

---

<div class="post-metadata">

**Author:** ![emptyemail](https://avatars.discourse-cdn.com/v4/letter/e/6de8d8/32.png) [@emptyemail](https://discuss.elastic.co/u/emptyemail)\
**Post date:** [May 13, 2015, 10:12pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/3 "2015-05-13T22:12:22Z")

</div>

Hi Mark, thanks for the quick reply.

I tried both ways, with and without cluster. prefix

I am setting node.rack, and node.zone The allocation awareness is working, but I have to manually issue a curl/api post to enable it.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 13, 2015, 10:17pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/4 "2015-05-13T22:17:42Z")

</div>

It might be better if you post your config so we can take a look?

---

<div class="post-metadata">

**Author:** ![emptyemail](https://avatars.discourse-cdn.com/v4/letter/e/6de8d8/32.png) [@emptyemail](https://discuss.elastic.co/u/emptyemail)\
**Post date:** [May 13, 2015, 10:29pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/5 "2015-05-13T22:29:44Z")

</div>

Here you go. I've verified that all the variables are set correctly in the environment.

```auto
discovery:
  type: ec2
  ec2:
    tag:
      Name: ${master}
path:
  data: /data
cluster:
  name: ${name}
node:
  data: ${is_data}
  master: ${is_master}
  zone: ${zone}
  rack: ${rack}

network.publish_host: "_ec2_"
bootstrap.mlockall: true

threadpool.bulk.queue_size : 500
cluster.routing.allocation.awareness.attributes: rack,zone
cluster.routing.allocation.node_concurrent_recoveries: 5
indices.recovery.max_bytes_per_sec: 50mb

```

---

<div class="post-metadata">

**Author:** ![russK](https://avatars.discourse-cdn.com/v4/letter/r/9fc348/32.png) [@russK](https://discuss.elastic.co/u/russK)\
**Post date:** [May 14, 2015, 3:18pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/6 "2015-05-14T15:18:45Z")

</div>

I've been having similar issues with ec2 clustering discovery. Using the following guide and modifying according to the changes from 1.4.4 to 1.5.2 I've got all the different boxes up and running on AWS, but apparently the two elasticsearch nodes aren't joining into a cluster.

Link = [https://github.com/andrewpuch/elasticsearch-logstash-kibana-tutorial/blob/master/README.md](https://github.com/andrewpuch/elasticsearch-logstash-kibana-tutorial/blob/master/README.md)

Here's what I've got for my elasticsearch.yml

```
cluster.name: elasticsearch

cloud.aws.access_key: <MY_ACCESS_KEY>

cloud.aws.secret_key: <MY_SECRET_KEY>

cloud.aws.region: us-west-2

discovery.type: ec2

discovery.zen.ping.multicast.enabled: false

discovery.ec2.groups: my_security_group

discovery.ec2.tag.Name: "ELK - Elasticsearch"

http.cors.enabled: true

http.cors.allow-origin: "*"

```

It seems that the yml format has changed according to the elastic git for cloud-aws, but I can't quite parse how to make of the correct changes.

[https://github.com/elastic/elasticsearch-cloud-aws](https://github.com/elastic/elasticsearch-cloud-aws)

I'm happy to provide any other information that would be useful to debug this issue!  
Cheers

---

<div class="post-metadata">

**Author:** ![emptyemail](https://avatars.discourse-cdn.com/v4/letter/e/6de8d8/32.png) [@emptyemail](https://discuss.elastic.co/u/emptyemail)\
**Post date:** [May 14, 2015, 4:06pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/7 "2015-05-14T16:06:33Z")

</div>

Does the IAM user have access to describe instances?  
Does the security group allow traffic on 9300 to instances within the security group?  
Did you upgrade the aws plugin when you upgraded ElasticSearch?  
Do both instances have "ELK - Elasticsearch" as their name?

The config I posted runs fine on es 1.5.2 within an aws vpc

---

<div class="post-metadata">

**Author:** ![russK](https://avatars.discourse-cdn.com/v4/letter/r/9fc348/32.png) [@russK](https://discuss.elastic.co/u/russK)\
**Post date:** [May 14, 2015, 5:45pm UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/8 "2015-05-14T17:45:38Z")

</div>

I got my issue resolved. I was using an IAM key pair, but needed my AWS root keys. Once that change was made my devices clustered correctly with the yml file posted above.

To answer the questions:  
IAM user was the issue (see above)  
Traffic is allowed on 9200, 9300, and 5200  
Clean install of all current versions pulled from the [elastic.co](http://elastic.co) site  
Yes, both instances have "ELK - Elasticsearch" as their names

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:14am UTC](https://discuss.elastic.co/t/cluster-settings-from-elasticsearch-yml-are-not-working/650/9 "2017-07-06T00:14:00Z")

</div>

Closed on July 6, 2017, 12:14am UTC