# ElasticSearch Cluster Settings Tuneup

**URL:** https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260
**Category:** Elasticsearch
**Created:** [October 15, 2015, 11:11am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260 "2015-10-15T11:11:44Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![moni15moni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moni15moni/32/42311_2.png) [@moni15moni](https://discuss.elastic.co/u/moni15moni)
#### Post date: [October 15, 2015, 11:11am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260/1 "2015-10-15T11:11:44Z")

</div>

Hi ,

I have maintain a ES Cluster with 10 Boxes each with 24 CPUS and 64 GB memory with separate master nodes.Per day we have written 4 Billion docs about 2 TB of Storage .

We have create a index with 30 shards.i have mentioned below the index settings.If any ware we have to tune the cluster settings.we have a huge bulk indexing and less queries.Still cluster not getting stable.

Any one will suggest the following settings.

In Bulk Writing environment , Do we have to change any other cluster settings ? Here we are using Spinner Disks.

Right now we are running in elasticsearch 1.5.2 Version

Thanks in the advance.

```
"settings" : {    
    "number_of_shards" : 30,
    "number_of_replicas": 0,
    "index.store.compress.stored":"true",
    "index.store.compress.tv":"true",
     "compress.default.type":"snappy",
"index.query.default_field":"oplog",
"refresh_interval" : -1,
    "index.merge.policy.max_merge_at_once":10,
    "index.translog.flush_threshold_size": "2147483648",
"index.translog.interval": "30s",
    "index.store.type":"mmapfs"

```

* * *

* * *

* * *

}

Thanks  
Moni

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [October 15, 2015, 8:25pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260/2 "2015-10-15T20:25:46Z")

</div>

> [@moni15moni](#):
>
> a index with 30 shards

That's too many, you should reduce that to stop resource wastage.

---

<div class="post-metadata">

### Author: ![moni15moni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moni15moni/32/42311_2.png) [@moni15moni](https://discuss.elastic.co/u/moni15moni)
#### Post date: [October 19, 2015, 7:03am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260/3 "2015-10-19T07:03:02Z")

</div>

Thanks Mark for your reply

But one more thing in a particular index we have to store 50 - 60 Billion Docs .So we have required minimum no of 30 shards.So you are saying we have to use multiple indexes or any other suggestions.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [October 19, 2015, 8:23pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260/4 "2015-10-19T20:23:10Z")

</div>

Oh right, then you're not going to be able to get around that anyway.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 5, 2017, 11:43pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-settings-tuneup/32260/5 "2017-07-05T23:43:59Z")

</div>


