# ElasticSearch Setup on EC2

**URL:** <https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315>\
**Category:** Elasticsearch\
**Created:** [September 12, 2016, 4:27pm UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315 "2016-09-12T16:27:34Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Satendrakumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/satendrakumar/32/11506_2.png) [@Satendrakumar](https://discuss.elastic.co/u/Satendrakumar)\
**Post date:** [September 12, 2016, 4:27pm UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/1 "2016-09-12T16:27:34Z")

</div>

I am trying to setup ES cluster( 3 node) on EC2. I have tried lot of configs but ended with this config:

```
> cluster.name: ES-CLUSTER

> node.name: ES-NODE-01

> node.max_local_storage_nodes: 1

> node.rack_id: rack_us_east_1d

> index.number_of_shards: 16

> index.number_of_replicas: 1

> gateway.recover_after_nodes: 3

> gateway.recover_after_time: 2m

> gateway.expected_nodes: 3

> discovery.zen.minimum_master_nodes: 3

> discovery.zen.ping.multicast.enabled: false

> cloud.aws.access_key: ********
> cloud.aws.secret_key: ******

> cloud.aws.region: us-east-1

> discovery.type: ec2

> discovery.ec2.groups: groups-name

> plugin.mandatory: cloud-aws,analysis-icu,analysis-phonetic

> http.cors.enabled: true

> http.cors.allow-origin: "*"

> network.host: _ec2:privateIpv4_

> network.bind_host: 0.0.0.0

> network.publish_host: _ec2:privateIpv4_

```

Now it is working. I am not sure it is right setting or not ?

Can anybody guide me what is right way t do this ?  
Thanks

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 13, 2016, 7:26am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/2 "2016-09-13T07:26:53Z")

</div>

> [@Satendrakumar](#):
>
> Can anybody guide me what is right way t do this ?

> [@Satendrakumar](#):
>
> index.number\_of\_shards: 16

That's probably too many.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [September 13, 2016, 7:51am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/3 "2016-09-13T07:51:45Z")

</div>

And also be aware that you won't be able to define `index.number_of_shards` in `elasticsearch.yml` in 5.0. You should use an index template for that.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 13, 2016, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/4 "2016-09-13T07:52:17Z")

</div>

While we are at it, it's Elasticsearch, not ElasticSearch. That's definitely a best practise 😉

---

<div class="post-metadata">

**Author:** ![Satendrakumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/satendrakumar/32/11506_2.png) [@Satendrakumar](https://discuss.elastic.co/u/Satendrakumar)\
**Post date:** [September 13, 2016, 8:03am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/5 "2016-09-13T08:03:12Z")

</div>

What are the recommended number for number\_of\_shards ?  
Our use case are 20 parallel requests where each request average 10k documents.  
@warkolm Ok, Next time I would follow it.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 13, 2016, 8:09am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/6 "2016-09-13T08:09:11Z")

</div>

> [@Satendrakumar](#):
>
> Our use case are 20 parallel requests where each request average 10k documents.

What sort of requests would need that many docs in one?

---

<div class="post-metadata">

**Author:** ![Satendrakumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/satendrakumar/32/11506_2.png) [@Satendrakumar](https://discuss.elastic.co/u/Satendrakumar)\
**Post date:** [September 13, 2016, 10:10am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/7 "2016-09-13T10:10:18Z")

</div>

one request contains one CSV data.  
@warkolm

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 13, 2016, 10:11am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/8 "2016-09-13T10:11:44Z")

</div>

You mean you are bulk indexing these?

---

<div class="post-metadata">

**Author:** ![Satendrakumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/satendrakumar/32/11506_2.png) [@Satendrakumar](https://discuss.elastic.co/u/Satendrakumar)\
**Post date:** [September 13, 2016, 10:13am UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/9 "2016-09-13T10:13:41Z")

</div>

yes.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:20pm UTC](https://discuss.elastic.co/t/elasticsearch-setup-on-ec2/60315/10 "2017-07-05T22:20:48Z")

</div>


