# ElasticSearch Cluster setup

**URL:** <https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536>\
**Category:** Elasticsearch\
**Created:** [January 29, 2013, 8:09am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536 "2013-01-29T08:09:05Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ankit\_Jain](https://avatars.discourse-cdn.com/v4/letter/a/96bed5/32.png) [@Ankit\_Jain](https://discuss.elastic.co/u/Ankit_Jain)\
**Post date:** [January 29, 2013, 8:09am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/1 "2013-01-29T08:09:05Z")

</div>

Hi All,

I am new on elasticsearch and want to setup it on distributed mode.

Please share any good article on the same.

Thanks,  
Ankit

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 29, 2013, 8:19am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/2 "2013-01-29T08:19:40Z")

</div>

Hi Ankit,

Elasticsearch IS a distributed search engine.

Just start new nodes on your network and Elasticsearch will detect them and do the rebalancing job for you.

You have many articles and video that talk about that. See: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/videos/)  
Also, look at this page: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/modules/discovery/zen.html)

Does it help?

Le 29 janv. 2013 à 09:09, Ankit Jain [ankitjaincs06@gmail.com](mailto:ankitjaincs06@gmail.com) a écrit :

> Hi All,
> 
> I am new on elasticsearch and want to setup it on distributed mode.
> 
> Please share any good article on the same.
> 
> Thanks,  
> Ankit
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Ankit\_Jain](https://avatars.discourse-cdn.com/v4/letter/a/96bed5/32.png) [@Ankit\_Jain](https://discuss.elastic.co/u/Ankit_Jain)\
**Post date:** [January 29, 2013, 9:10am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/3 "2013-01-29T09:10:59Z")

</div>

Thanks for reply ...

So, Whenever we add a new node in network using the same clustername, it  
will automatically became a part of cluster.

Let me know, if i miss something

~Ankit

On Tuesday, 29 January 2013 13:49:40 UTC+5:30, David Pilato wrote:

> Hi Ankit,
> 
> Elasticsearch IS a distributed search engine.
> 
> Just start new nodes on your network and Elasticsearch will detect them  
> and do the rebalancing job for you.
> 
> You have many articles and video that talk about that. See:  
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/videos/)  
> Also, look at this page:  
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/modules/discovery/zen.html)
> 
> Does it help?
> 
> Le 29 janv. 2013 à 09:09, Ankit Jain \<[ankitj...@gmail.com](mailto:ankitj...@gmail.com) \<javascript:\>\>  
> a écrit :
> 
> Hi All,
> 
> I am new on elasticsearch and want to setup it on distributed mode.
> 
> Please share any good article on the same.
> 
> Thanks,  
> Ankit
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 29, 2013, 9:20am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/4 "2013-01-29T09:20:15Z")

</div>

Yes that's it.

Sometimes, it's too much magic 😉

Imagine you have coworkers and all of you are using the default cluster name which is elasticsearch.  
When one of your coworker will run its ES instance he will get all your own indices.  
And if he runs something like: curl -XDELETE localhost:9200/ he will erase its indices but also yours! 😉

So, if you have coworkers, the first thing to do is to change your cluster name in config/elasticsearch.yml

Le 29 janv. 2013 à 10:10, Ankit Jain [ankitjaincs06@gmail.com](mailto:ankitjaincs06@gmail.com) a écrit :

> Thanks for reply ...
> 
> So, Whenever we add a new node in network using the same clustername, it will automatically became a part of cluster.
> 
> Let me know, if i miss something
> 
> ~Ankit
> 
> On Tuesday, 29 January 2013 13:49:40 UTC+5:30, David Pilato wrote:  
> Hi Ankit,
> 
> Elasticsearch IS a distributed search engine.
> 
> Just start new nodes on your network and Elasticsearch will detect them and do the rebalancing job for you.
> 
> You have many articles and video that talk about that. See: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/videos/)  
> Also, look at this page: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/modules/discovery/zen.html)
> 
> Does it help?
> 
> Le 29 janv. 2013 à 09:09, Ankit Jain [ankitj...@gmail.com](mailto:ankitj...@gmail.com) a écrit :
> 
> > Hi All,
> > 
> > I am new on elasticsearch and want to setup it on distributed mode.
> > 
> > Please share any good article on the same.
> > 
> > Thanks,  
> > Ankit
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![tarang\_dawer](https://avatars.discourse-cdn.com/v4/letter/t/c0e974/32.png) [@tarang\_dawer](https://discuss.elastic.co/u/tarang_dawer)\
**Post date:** [January 29, 2013, 9:49am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/5 "2013-01-29T09:49:45Z")

</div>

Hi

i am also trying out E.S

what optimizations (changing parameters) should i make to the ES  
configuration , or , while creating a java Node client , to achieve  
maximum indexing performance ?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [January 29, 2013, 9:54am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/6 "2013-01-29T09:54:55Z")

</div>

This is a very large question.  
Mostly, Elasticsearch is by default set up with _nice_ settings. _Best_ settings depend really on your use case, the boxes you are running Elasticsearch on…

So generally speaking, I would say: "try with defaults!".

About indexing, use Bulk indexing instead of indexing documents one by one.

Have a look here: [https://github.com/elasticsearchfr/hands-on/blob/answers/src/test/java/org/elasticsearchfr/handson/ex1/IndexTest.java#L113](https://github.com/elasticsearchfr/hands-on/blob/answers/src/test/java/org/elasticsearchfr/handson/ex1/IndexTest.java#L113)

Le 29 janv. 2013 à 10:49, tarang dawer [tarang.dawer@gmail.com](mailto:tarang.dawer@gmail.com) a écrit :

> Hi
> 
> i am also trying out E.S
> 
> what optimizations (changing parameters) should i make to the ES configuration , or , while creating a java Node client , to achieve maximum indexing performance ?
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [January 29, 2013, 9:57am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/7 "2013-01-29T09:57:05Z")

</div>

What kind of performance are you interested in?

- maximum throughput?
- fastest time to index a fixed amount of data?
- minimal latency (for realtime indexing)?

Just to give a few points to consider for performance targets.

And, what is your environment, what is hardware you can provide? What  
disks, what OS, what Java?

Have you tried the standard ES configuration? Have you tried bulk indexing?

Jörg

Am 29.01.13 10:49, schrieb tarang dawer:

> Hi
> 
> i am also trying out E.S
> 
> ## what optimizations (changing parameters) should i make to the ES configuration , or , while creating a java Node client , to achieve maximum indexing performance ?
> 
> You received this message because you are subscribed to the Google  
> Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send  
> an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![tarang\_dawer](https://avatars.discourse-cdn.com/v4/letter/t/c0e974/32.png) [@tarang\_dawer](https://discuss.elastic.co/u/tarang_dawer)\
**Post date:** [January 29, 2013, 11:26am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/8 "2013-01-29T11:26:48Z")

</div>

hi  
i have 3 machines , 4 cores , 4 gb , 512 Gb each  
i need optimization for maximum throughput , with real time indexing but  
can afford a refreshing of index upto 20-30 seconds , until the record  
becomes searchable. i am getting record one by one , so , i haven't tried  
the bulk indexing.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![tarang\_dawer](https://avatars.discourse-cdn.com/v4/letter/t/c0e974/32.png) [@tarang\_dawer](https://discuss.elastic.co/u/tarang_dawer)\
**Post date:** [January 30, 2013, 9:23am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/9 "2013-01-30T09:23:25Z")

</div>

hi  
i added the following configuration to the elasticsearch.yml file

index.refresh\_interval: 5

indices.memory.index\_buffer\_size: 20%

index.translog.flush\_threshold\_period: 5s

index.cache.field.type: soft

min\_index\_buffer\_size: 1024mb

max\_index\_buffer\_size: 2048mb

indices.memory.min\_shard\_index\_buffer\_size: 512mb

along with it , added to env variables to /bin/elasticsearch

ES\_MIN\_MEM=1024m  
ES\_MAX\_MEM=2048m

still could not find appreciable difference in indexing performance . is it  
the case , that m i doing something wrong ? or should i add some other  
parameter also . please help me out.

thanks

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:54am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup/10536/10 "2017-07-06T02:54:02Z")

</div>


