# Starting multiple ES instances on one physical server

**URL:** <https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523>\
**Category:** Elasticsearch\
**Created:** [May 1, 2012, 2:11pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523 "2012-05-01T14:11:19Z")\
**Posts on this page:** 18\
**Page:** 1

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 1, 2012, 2:11pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/1 "2012-05-01T14:11:19Z")

</div>

Hi,

I am able to run multiple ES instances on one windows server from bat  
file.  
I want to run multiple ES instances through single or multiple ES  
services.  
Server configuration:  
Windows 32 bit  
24 core cpu  
32 GB ram

I am going to production so this is critical for me. Please help me.

Thanks and Regards  
Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 2, 2012, 4:28pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/2 "2012-05-02T16:28:43Z")

</div>

First, why do you need to run multiple ES instances? You don't really need  
to... . Second, just run several instances of the service, or is that a  
problem?

On Tue, May 1, 2012 at 5:11 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> Hi,
> 
> I am able to run multiple ES instances on one windows server from bat  
> file.  
> I want to run multiple ES instances through single or multiple ES  
> services.  
> Server configuration:  
> Windows 32 bit  
> 24 core cpu  
> 32 GB ram
> 
> I am going to production so this is critical for me. Please help me.
> 
> Thanks and Regards  
> Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 2, 2012, 4:39pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/3 "2012-05-02T16:39:50Z")

</div>

Thanks Shay for your response.

I have 2 servers of following configuration  
Windows 32 bit  
24 core cpu  
32 GB ram

Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
to one ES instance. I am doing term faceting for which I need more  
memory.  
Yes I tried to run several instances of service your your service  
wrapper but unable to do that.

> **[GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of...](https://github.com/elastic/elasticsearch-servicewrapper)**
>
> A service wrapper on top of elasticsearch. Contribute to elastic/elasticsearch-servicewrapper development by creating an account on GitHub.

I want to control automatic restart if my ES instances if it goes  
unresponsive. Any suggestions for this?

Thanks and rewgards  
Jagdeep

On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:

> First, why do you need to run multiple ES instances? You don't really need  
> to... . Second, just run several instances of the service, or is that a  
> problem?
> 
> On Tue, May 1, 2012 at 5:11 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> 
> > Hi,
> 
> > I am able to run multiple ES instances on one windows server from bat  
> > file.  
> > I want to run multiple ES instances through single or multiple ES  
> > services.  
> > Server configuration:  
> > Windows 32 bit  
> > 24 core cpu  
> > 32 GB ram
> 
> > I am going to production so this is critical for me. Please help me.
> 
> > Thanks and Regards  
> > Jagdeep

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 2, 2012, 4:48pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/4 "2012-05-02T16:48:44Z")

</div>

Clone your ES directory in 2 dir :  
Es1  
Es2

Then launch es1/bin/elastisearch.bat  
And es2/bin/elastisearch.bat

IMHO it's a bad idea to run ES for production usage under Windows.

David 😉  
Twitter : @dadoonet / @elasticsearchfr

Le 2 mai 2012 à 18:39, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com) a écrit :

> Thanks Shay for your response.
> 
> I have 2 servers of following configuration  
> Windows 32 bit  
> 24 core cpu  
> 32 GB ram
> 
> Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> to one ES instance. I am doing term faceting for which I need more  
> memory.  
> Yes I tried to run several instances of service your your service  
> wrapper but unable to do that.  
> [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> I want to control automatic restart if my ES instances if it goes  
> unresponsive. Any suggestions for this?
> 
> Thanks and rewgards  
> Jagdeep
> 
> On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > First, why do you need to run multiple ES instances? You don't really need  
> > to... . Second, just run several instances of the service, or is that a  
> > problem?
> > 
> > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> > 
> > > Hi,
> > 
> > > I am able to run multiple ES instances on one windows server from bat  
> > > file.  
> > > I want to run multiple ES instances through single or multiple ES  
> > > services.  
> > > Server configuration:  
> > > Windows 32 bit  
> > > 24 core cpu  
> > > 32 GB ram
> > 
> > > I am going to production so this is critical for me. Please help me.
> > 
> > > Thanks and Regards  
> > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 2, 2012, 4:49pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/5 "2012-05-02T16:49:40Z")

</div>

Are you saying you can only use the java windows 32bit? Is that because  
thats the only one available in the servicewrapper community edition? Its a  
shame if thats the case, you could try and use other way to start ES in  
windows as a service, and use a 64bit JVM, it will be much better than  
starting 10 instances of ES.... . Maybe try this:  
[Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).

On Wed, May 2, 2012 at 7:39 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> Thanks Shay for your response.
> 
> I have 2 servers of following configuration  
> Windows 32 bit  
> 24 core cpu  
> 32 GB ram
> 
> Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> to one ES instance. I am doing term faceting for which I need more  
> memory.  
> Yes I tried to run several instances of service your your service  
> wrapper but unable to do that.  
> [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> I want to control automatic restart if my ES instances if it goes  
> unresponsive. Any suggestions for this?
> 
> Thanks and rewgards  
> Jagdeep
> 
> On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > First, why do you need to run multiple ES instances? You don't really  
> > need  
> > to... . Second, just run several instances of the service, or is that a  
> > problem?
> > 
> > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > wrote:
> > 
> > > Hi,
> > 
> > > I am able to run multiple ES instances on one windows server from bat  
> > > file.  
> > > I want to run multiple ES instances through single or multiple ES  
> > > services.  
> > > Server configuration:  
> > > Windows 32 bit  
> > > 24 core cpu  
> > > 32 GB ram
> > 
> > > I am going to production so this is critical for me. Please help me.
> > 
> > > Thanks and Regards  
> > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 2, 2012, 4:52pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/6 "2012-05-02T16:52:14Z")

</div>

Ya David this is what I was doing earlier. But now I am starting  
multiple instances from single location only.

You are right cant do this in production ☹ I need proper service  
configuration.

Thanks and Regards  
Jagdeep

On May 2, 9:48 pm, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote:

> Clone your ES directory in 2 dir :  
> Es1  
> Es2
> 
> Then launch es1/bin/elastisearch.bat  
> And es2/bin/elastisearch.bat
> 
> IMHO it's a bad idea to run ES for production usage under Windows.
> 
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr
> 
> Le 2 mai 2012 à 18:39, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com) a écrit :
> 
> > Thanks Shay for your response.
> 
> > I have 2 servers of following configuration  
> > Windows 32 bit  
> > 24 core cpu  
> > 32 GB ram
> 
> > Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> > to one ES instance. I am doing term faceting for which I need more  
> > memory.  
> > Yes I tried to run several instances of service your your service  
> > wrapper but unable to do that.  
> > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> > I want to control automatic restart if my ES instances if it goes  
> > unresponsive. Any suggestions for this?
> 
> > Thanks and rewgards  
> > Jagdeep
> 
> > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > 
> > > First, why do you need to run multiple ES instances? You don't really need  
> > > to... . Second, just run several instances of the service, or is that a  
> > > problem?
> 
> > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> 
> > > > Hi,
> 
> > > > I am able to run multiple ES instances on one windows server from bat  
> > > > file.  
> > > > I want to run multiple ES instances through single or multiple ES  
> > > > services.  
> > > > Server configuration:  
> > > > Windows 32 bit  
> > > > 24 core cpu  
> > > > 32 GB ram
> 
> > > > I am going to production so this is critical for me. Please help me.
> 
> > > > Thanks and Regards  
> > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 2, 2012, 10:15pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/7 "2012-05-02T22:15:16Z")

</div>

You can not share the same data dir between your nodes.

David 😉  
Twitter : @dadoonet / @elasticsearchfr

Le 2 mai 2012 à 18:52, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com) a écrit :

> Ya David this is what I was doing earlier. But now I am starting  
> multiple instances from single location only.
> 
> You are right cant do this in production ☹ I need proper service  
> configuration.
> 
> Thanks and Regards  
> Jagdeep
> 
> On May 2, 9:48 pm, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote:
> 
> > Clone your ES directory in 2 dir :  
> > Es1  
> > Es2
> > 
> > Then launch es1/bin/elastisearch.bat  
> > And es2/bin/elastisearch.bat
> > 
> > IMHO it's a bad idea to run ES for production usage under Windows.
> > 
> > David 😉  
> > Twitter : @dadoonet / @elasticsearchfr
> > 
> > Le 2 mai 2012 à 18:39, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com) a écrit :
> > 
> > > Thanks Shay for your response.
> > 
> > > I have 2 servers of following configuration  
> > > Windows 32 bit  
> > > 24 core cpu  
> > > 32 GB ram
> > 
> > > Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> > > to one ES instance. I am doing term faceting for which I need more  
> > > memory.  
> > > Yes I tried to run several instances of service your your service  
> > > wrapper but unable to do that.  
> > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > 
> > > I want to control automatic restart if my ES instances if it goes  
> > > unresponsive. Any suggestions for this?
> > 
> > > Thanks and rewgards  
> > > Jagdeep
> > 
> > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > 
> > > > First, why do you need to run multiple ES instances? You don't really need  
> > > > to... . Second, just run several instances of the service, or is that a  
> > > > problem?
> > 
> > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> > 
> > > > > Hi,
> > 
> > > > > I am able to run multiple ES instances on one windows server from bat  
> > > > > file.  
> > > > > I want to run multiple ES instances through single or multiple ES  
> > > > > services.  
> > > > > Server configuration:  
> > > > > Windows 32 bit  
> > > > > 24 core cpu  
> > > > > 32 GB ram
> > 
> > > > > I am going to production so this is critical for me. Please help me.
> > 
> > > > > Thanks and Regards  
> > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 3, 2012, 5:14am UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/8 "2012-05-03T05:14:15Z")

</div>

Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
service wrapper is not at all an issue. I am already using it on 64  
bit OS but it has only 8 GB RAM.  
I am trying to port to 64bit OS and jvm but it will take some time.  
Will have to find an alternate by that time.  
Unattended recovery of ES instances if it goes unresponsive is my main  
concern for which I am not able to find appropriate approach.

Thanks and Regards  
Jagdeep

On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:

> Are you saying you can only use the java windows 32bit? Is that because  
> thats the only one available in the servicewrapper community edition? Its a  
> shame if thats the case, you could try and use other way to start ES in  
> windows as a service, and use a 64bit JVM, it will be much better than  
> starting 10 instances of ES.... . Maybe try this:[Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> 
> On Wed, May 2, 2012 at 7:39 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> 
> > Thanks Shay for your response.
> 
> > I have 2 servers of following configuration  
> > Windows 32 bit  
> > 24 core cpu  
> > 32 GB ram
> 
> > Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> > to one ES instance. I am doing term faceting for which I need more  
> > memory.  
> > Yes I tried to run several instances of service your your service  
> > wrapper but unable to do that.  
> > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> > I want to control automatic restart if my ES instances if it goes  
> > unresponsive. Any suggestions for this?
> 
> > Thanks and rewgards  
> > Jagdeep
> 
> > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > 
> > > First, why do you need to run multiple ES instances? You don't really  
> > > need  
> > > to... . Second, just run several instances of the service, or is that a  
> > > problem?
> 
> > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > wrote:
> 
> > > > Hi,
> 
> > > > I am able to run multiple ES instances on one windows server from bat  
> > > > file.  
> > > > I want to run multiple ES instances through single or multiple ES  
> > > > services.  
> > > > Server configuration:  
> > > > Windows 32 bit  
> > > > 24 core cpu  
> > > > 32 GB ram
> 
> > > > I am going to production so this is critical for me. Please help me.
> 
> > > > Thanks and Regards  
> > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 4, 2012, 1:13pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/9 "2012-05-04T13:13:33Z")

</div>

You mean that you get into problems when it runs OOM, and you can't recover  
the data? Can you gist hte OOM failure you get in the logs in this case?

On Thu, May 3, 2012 at 8:14 AM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
> service wrapper is not at all an issue. I am already using it on 64  
> bit OS but it has only 8 GB RAM.  
> I am trying to port to 64bit OS and jvm but it will take some time.  
> Will have to find an alternate by that time.  
> Unattended recovery of ES instances if it goes unresponsive is my main  
> concern for which I am not able to find appropriate approach.
> 
> Thanks and Regards  
> Jagdeep
> 
> On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > Are you saying you can only use the java windows 32bit? Is that because  
> > thats the only one available in the servicewrapper community edition?  
> > Its a  
> > shame if thats the case, you could try and use other way to start ES in  
> > windows as a service, and use a 64bit JVM, it will be much better than  
> > starting 10 instances of ES.... . Maybe try this:  
> > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> > 
> > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > wrote:
> > 
> > > Thanks Shay for your response.
> > 
> > > I have 2 servers of following configuration  
> > > Windows 32 bit  
> > > 24 core cpu  
> > > 32 GB ram
> > 
> > > Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> > > to one ES instance. I am doing term faceting for which I need more  
> > > memory.  
> > > Yes I tried to run several instances of service your your service  
> > > wrapper but unable to do that.  
> > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > 
> > > I want to control automatic restart if my ES instances if it goes  
> > > unresponsive. Any suggestions for this?
> > 
> > > Thanks and rewgards  
> > > Jagdeep
> > 
> > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > 
> > > > First, why do you need to run multiple ES instances? You don't really  
> > > > need  
> > > > to... . Second, just run several instances of the service, or is  
> > > > that a  
> > > > problem?
> > 
> > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > wrote:
> > 
> > > > > Hi,
> > 
> > > > > I am able to run multiple ES instances on one windows server from  
> > > > > bat  
> > > > > file.  
> > > > > I want to run multiple ES instances through single or multiple ES  
> > > > > services.  
> > > > > Server configuration:  
> > > > > Windows 32 bit  
> > > > > 24 core cpu  
> > > > > 32 GB ram
> > 
> > > > > I am going to production so this is critical for me. Please help  
> > > > > me.
> > 
> > > > > Thanks and Regards  
> > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 4, 2012, 1:38pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/10 "2012-05-04T13:38:29Z")

</div>

I am able to recover the data.. "there is no data loss" but I have to  
manually restart the server after OOM.  
Will post the gist also.

Thanks and Regards  
Jagdeep

On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:

> You mean that you get into problems when it runs OOM, and you can't recover  
> the data? Can you gist hte OOM failure you get in the logs in this case?
> 
> On Thu, May 3, 2012 at 8:14 AM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> 
> > Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
> > service wrapper is not at all an issue. I am already using it on 64  
> > bit OS but it has only 8 GB RAM.  
> > I am trying to port to 64bit OS and jvm but it will take some time.  
> > Will have to find an alternate by that time.  
> > Unattended recovery of ES instances if it goes unresponsive is my main  
> > concern for which I am not able to find appropriate approach.
> 
> > Thanks and Regards  
> > Jagdeep
> 
> > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > 
> > > Are you saying you can only use the java windows 32bit? Is that because  
> > > thats the only one available in the servicewrapper community edition?  
> > > Its a  
> > > shame if thats the case, you could try and use other way to start ES in  
> > > windows as a service, and use a 64bit JVM, it will be much better than  
> > > starting 10 instances of ES.... . Maybe try this:  
> > > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> 
> > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > wrote:
> 
> > > > Thanks Shay for your response.
> 
> > > > I have 2 servers of following configuration  
> > > > Windows 32 bit  
> > > > 24 core cpu  
> > > > 32 GB ram
> 
> > > > Since its windows 32 bit I am not able to allocate more than 1.5gb RAM  
> > > > to one ES instance. I am doing term faceting for which I need more  
> > > > memory.  
> > > > Yes I tried to run several instances of service your your service  
> > > > wrapper but unable to do that.  
> > > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> > > > I want to control automatic restart if my ES instances if it goes  
> > > > unresponsive. Any suggestions for this?
> 
> > > > Thanks and rewgards  
> > > > Jagdeep
> 
> > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > 
> > > > > First, why do you need to run multiple ES instances? You don't really  
> > > > > need  
> > > > > to... . Second, just run several instances of the service, or is  
> > > > > that a  
> > > > > problem?
> 
> > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > wrote:
> 
> > > > > > Hi,
> 
> > > > > > I am able to run multiple ES instances on one windows server from  
> > > > > > bat  
> > > > > > file.  
> > > > > > I want to run multiple ES instances through single or multiple ES  
> > > > > > services.  
> > > > > > Server configuration:  
> > > > > > Windows 32 bit  
> > > > > > 24 core cpu  
> > > > > > 32 GB ram
> 
> > > > > > I am going to production so this is critical for me. Please help  
> > > > > > me.
> 
> > > > > > Thanks and Regards  
> > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 4, 2012, 1:47pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/11 "2012-05-04T13:47:57Z")

</div>

It might be needed, yea. Especially if the memory pressure does not relent  
(for example, memory is being cleaned and then added immediately after).  
You can configure the JVM to execute a script on OOM, potentially killing  
the service.

On Fri, May 4, 2012 at 4:38 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> I am able to recover the data.. "there is no data loss" but I have to  
> manually restart the server after OOM.  
> Will post the gist also.
> 
> Thanks and Regards  
> Jagdeep
> 
> On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > You mean that you get into problems when it runs OOM, and you can't  
> > recover  
> > the data? Can you gist hte OOM failure you get in the logs in this case?
> > 
> > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > wrote:
> > 
> > > Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
> > > service wrapper is not at all an issue. I am already using it on 64  
> > > bit OS but it has only 8 GB RAM.  
> > > I am trying to port to 64bit OS and jvm but it will take some time.  
> > > Will have to find an alternate by that time.  
> > > Unattended recovery of ES instances if it goes unresponsive is my main  
> > > concern for which I am not able to find appropriate approach.
> > 
> > > Thanks and Regards  
> > > Jagdeep
> > 
> > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > 
> > > > Are you saying you can only use the java windows 32bit? Is that  
> > > > because  
> > > > thats the only one available in the servicewrapper community edition?  
> > > > Its a  
> > > > shame if thats the case, you could try and use other way to start ES  
> > > > in  
> > > > windows as a service, and use a 64bit JVM, it will be much better  
> > > > than  
> > > > starting 10 instances of ES.... . Maybe try this:  
> > > > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> > 
> > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > wrote:
> > 
> > > > > Thanks Shay for your response.
> > 
> > > > > I have 2 servers of following configuration  
> > > > > Windows 32 bit  
> > > > > 24 core cpu  
> > > > > 32 GB ram
> > 
> > > > > Since its windows 32 bit I am not able to allocate more than 1.5gb  
> > > > > RAM  
> > > > > to one ES instance. I am doing term faceting for which I need more  
> > > > > memory.  
> > > > > Yes I tried to run several instances of service your your service  
> > > > > wrapper but unable to do that.  
> > > > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > 
> > > > > I want to control automatic restart if my ES instances if it goes  
> > > > > unresponsive. Any suggestions for this?
> > 
> > > > > Thanks and rewgards  
> > > > > Jagdeep
> > 
> > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > 
> > > > > > First, why do you need to run multiple ES instances? You don't  
> > > > > > really  
> > > > > > need  
> > > > > > to... . Second, just run several instances of the service, or is  
> > > > > > that a  
> > > > > > problem?
> > 
> > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > wrote:
> > 
> > > > > > > Hi,
> > 
> > > > > > > I am able to run multiple ES instances on one windows server  
> > > > > > > from  
> > > > > > > bat  
> > > > > > > file.  
> > > > > > > I want to run multiple ES instances through single or multiple  
> > > > > > > ES  
> > > > > > > services.  
> > > > > > > Server configuration:  
> > > > > > > Windows 32 bit  
> > > > > > > 24 core cpu  
> > > > > > > 32 GB ram
> > 
> > > > > > > I am going to production so this is critical for me. Please  
> > > > > > > help  
> > > > > > > me.
> > 
> > > > > > > Thanks and Regards  
> > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 7, 2012, 3:08pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/12 "2012-05-07T15:08:03Z")

</div>

Hi Shay,

I have copied the log to gist

> <https://gist.github.com/Jagdeep1/2627823>

I am doing the term faceting and oom is expected and accepted for  
that. But system should recover from this, it can't just go  
unresponsive and need manual restart of the server. Please suggest if  
I need to change number of nodes or configuration.

Thanks and Regards  
Jagdeep

On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:

> It might be needed, yea. Especially if the memory pressure does not relent  
> (for example, memory is being cleaned and then added immediately after).  
> You can configure the JVM to execute a script on OOM, potentially killing  
> the service.
> 
> On Fri, May 4, 2012 at 4:38 PM, jagdeep singh [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)wrote:
> 
> > I am able to recover the data.. "there is no data loss" but I have to  
> > manually restart the server after OOM.  
> > Will post the gist also.
> 
> > Thanks and Regards  
> > Jagdeep
> 
> > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > 
> > > You mean that you get into problems when it runs OOM, and you can't  
> > > recover  
> > > the data? Can you gist hte OOM failure you get in the logs in this case?
> 
> > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > wrote:
> 
> > > > Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
> > > > service wrapper is not at all an issue. I am already using it on 64  
> > > > bit OS but it has only 8 GB RAM.  
> > > > I am trying to port to 64bit OS and jvm but it will take some time.  
> > > > Will have to find an alternate by that time.  
> > > > Unattended recovery of ES instances if it goes unresponsive is my main  
> > > > concern for which I am not able to find appropriate approach.
> 
> > > > Thanks and Regards  
> > > > Jagdeep
> 
> > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > 
> > > > > Are you saying you can only use the java windows 32bit? Is that  
> > > > > because  
> > > > > thats the only one available in the servicewrapper community edition?  
> > > > > Its a  
> > > > > shame if thats the case, you could try and use other way to start ES  
> > > > > in  
> > > > > windows as a service, and use a 64bit JVM, it will be much better  
> > > > > than  
> > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> 
> > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > wrote:
> 
> > > > > > Thanks Shay for your response.
> 
> > > > > > I have 2 servers of following configuration  
> > > > > > Windows 32 bit  
> > > > > > 24 core cpu  
> > > > > > 32 GB ram
> 
> > > > > > Since its windows 32 bit I am not able to allocate more than 1.5gb  
> > > > > > RAM  
> > > > > > to one ES instance. I am doing term faceting for which I need more  
> > > > > > memory.  
> > > > > > Yes I tried to run several instances of service your your service  
> > > > > > wrapper but unable to do that.  
> > > > > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> 
> > > > > > I want to control automatic restart if my ES instances if it goes  
> > > > > > unresponsive. Any suggestions for this?
> 
> > > > > > Thanks and rewgards  
> > > > > > Jagdeep
> 
> > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > 
> > > > > > > First, why do you need to run multiple ES instances? You don't  
> > > > > > > really  
> > > > > > > need  
> > > > > > > to... . Second, just run several instances of the service, or is  
> > > > > > > that a  
> > > > > > > problem?
> 
> > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > wrote:
> 
> > > > > > > > Hi,
> 
> > > > > > > > I am able to run multiple ES instances on one windows server  
> > > > > > > > from  
> > > > > > > > bat  
> > > > > > > > file.  
> > > > > > > > I want to run multiple ES instances through single or multiple  
> > > > > > > > ES  
> > > > > > > > services.  
> > > > > > > > Server configuration:  
> > > > > > > > Windows 32 bit  
> > > > > > > > 24 core cpu  
> > > > > > > > 32 GB ram
> 
> > > > > > > > I am going to production so this is critical for me. Please  
> > > > > > > > help  
> > > > > > > > me.
> 
> > > > > > > > Thanks and Regards  
> > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 9, 2012, 8:58am UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/13 "2012-05-09T08:58:25Z")

</div>

Well, OOM in Java is a strange beast, if you don't send any more requests  
like the one you posted, which obviously can't be allocated, then the  
system will probably recover. But if you continue to send more requests,  
you will get into problems with the GC stalling the JVM.

Make sure you run a single node on the machine, and not several (I think  
its the same one with the 32bit, which means you are not using the machine  
resources properly), and allocate enough nodes to accommodate for it.

On Mon, May 7, 2012 at 6:08 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> Hi Shay,
> 
> I have copied the log to gist  
> [ES oom log and settings · GitHub](https://gist.github.com/2627823)
> 
> I am doing the term faceting and oom is expected and accepted for  
> that. But system should recover from this, it can't just go  
> unresponsive and need manual restart of the server. Please suggest if  
> I need to change number of nodes or configuration.
> 
> Thanks and Regards  
> Jagdeep
> 
> On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> 
> > It might be needed, yea. Especially if the memory pressure does not  
> > relent  
> > (for example, memory is being cleaned and then added immediately after).  
> > You can configure the JVM to execute a script on OOM, potentially killing  
> > the service.
> > 
> > On Fri, May 4, 2012 at 4:38 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > wrote:
> > 
> > > I am able to recover the data.. "there is no data loss" but I have to  
> > > manually restart the server after OOM.  
> > > Will post the gist also.
> > 
> > > Thanks and Regards  
> > > Jagdeep
> > 
> > > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > 
> > > > You mean that you get into problems when it runs OOM, and you can't  
> > > > recover  
> > > > the data? Can you gist hte OOM failure you get in the logs in this  
> > > > case?
> > 
> > > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<  
> > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > wrote:
> > 
> > > > > Yes "java windows 32bit" is a constraint as of now now. Using 64bit  
> > > > > service wrapper is not at all an issue. I am already using it on 64  
> > > > > bit OS but it has only 8 GB RAM.  
> > > > > I am trying to port to 64bit OS and jvm but it will take some time.  
> > > > > Will have to find an alternate by that time.  
> > > > > Unattended recovery of ES instances if it goes unresponsive is my  
> > > > > main  
> > > > > concern for which I am not able to find appropriate approach.
> > 
> > > > > Thanks and Regards  
> > > > > Jagdeep
> > 
> > > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > 
> > > > > > Are you saying you can only use the java windows 32bit? Is that  
> > > > > > because  
> > > > > > thats the only one available in the servicewrapper community  
> > > > > > edition?  
> > > > > > Its a  
> > > > > > shame if thats the case, you could try and use other way to  
> > > > > > start ES  
> > > > > > in  
> > > > > > windows as a service, and use a 64bit JVM, it will be much better  
> > > > > > than  
> > > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> > 
> > > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > wrote:
> > 
> > > > > > > Thanks Shay for your response.
> > 
> > > > > > > I have 2 servers of following configuration  
> > > > > > > Windows 32 bit  
> > > > > > > 24 core cpu  
> > > > > > > 32 GB ram
> > 
> > > > > > > Since its windows 32 bit I am not able to allocate more than  
> > > > > > > 1.5gb  
> > > > > > > RAM  
> > > > > > > to one ES instance. I am doing term faceting for which I need  
> > > > > > > more  
> > > > > > > memory.  
> > > > > > > Yes I tried to run several instances of service your your  
> > > > > > > service  
> > > > > > > wrapper but unable to do that.  
> > > > > > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > 
> > > > > > > I want to control automatic restart if my ES instances if it  
> > > > > > > goes  
> > > > > > > unresponsive. Any suggestions for this?
> > 
> > > > > > > Thanks and rewgards  
> > > > > > > Jagdeep
> > 
> > > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > 
> > > > > > > > First, why do you need to run multiple ES instances? You  
> > > > > > > > don't  
> > > > > > > > really  
> > > > > > > > need  
> > > > > > > > to... . Second, just run several instances of the service,  
> > > > > > > > or is  
> > > > > > > > that a  
> > > > > > > > problem?
> > 
> > > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > wrote:
> > 
> > > > > > > > > Hi,
> > 
> > > > > > > > > I am able to run multiple ES instances on one windows  
> > > > > > > > > server  
> > > > > > > > > from  
> > > > > > > > > bat  
> > > > > > > > > file.  
> > > > > > > > > I want to run multiple ES instances through single or  
> > > > > > > > > multiple  
> > > > > > > > > ES  
> > > > > > > > > services.  
> > > > > > > > > Server configuration:  
> > > > > > > > > Windows 32 bit  
> > > > > > > > > 24 core cpu  
> > > > > > > > > 32 GB ram
> > 
> > > > > > > > > I am going to production so this is critical for me. Please  
> > > > > > > > > help  
> > > > > > > > > me.
> > 
> > > > > > > > > Thanks and Regards  
> > > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 9, 2012, 9:36am UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/14 "2012-05-09T09:36:26Z")

</div>

Thanks Shay for your response.

Ok then I am considering to upgrade my OS to 64 bit so that i can allocate  
30 GB to 1 node only.

_There is one more scenario on same server_ - Earlier we were setting nodes  
as a combination of master and data, i.e. the  
default configuration of nodes acting both as master and data. We moved out  
of that configuration, and now each physical server is installed with 1  
instance of master node and 1 or more instances of data node. Due to such  
configuration, some data node might get unresponsive due to OOM, but the  
master node doesn't suffer the problem, and continue providing responses by  
gathering results from other data nodes as available.\* In case of multiple \*  
\*data node failure, results are provided with explicit OOM messages, which \*  
_is even better._ Using the timeout property in search queries didn't  
respond  
as expected, I don't know why, but provided it works, it will give the  
perfect solution to our problem.

Can you please explain the detailed task division of master and data  
nodes, and of the configuration of load-balancer node (neither master nor  
data). We did not actually find much usage of it in accordance with our  
setup.

Thanks and Regards  
Jagdeep

On Wednesday, May 9, 2012 2:28:25 PM UTC+5:30, kimchy wrote:

> Well, OOM in Java is a strange beast, if you don't send any more requests  
> like the one you posted, which obviously can't be allocated, then the  
> system will probably recover. But if you continue to send more requests,  
> you will get into problems with the GC stalling the JVM.
> 
> Make sure you run a single node on the machine, and not several (I think  
> its the same one with the 32bit, which means you are not using the machine  
> resources properly), and allocate enough nodes to accommodate for it.
> 
> On Mon, May 7, 2012 at 6:08 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> 
> > Hi Shay,
> > 
> > I have copied the log to gist  
> > [ES oom log and settings · GitHub](https://gist.github.com/2627823)
> > 
> > I am doing the term faceting and oom is expected and accepted for  
> > that. But system should recover from this, it can't just go  
> > unresponsive and need manual restart of the server. Please suggest if  
> > I need to change number of nodes or configuration.
> > 
> > Thanks and Regards  
> > Jagdeep
> > 
> > On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > 
> > > It might be needed, yea. Especially if the memory pressure does not  
> > > relent  
> > > (for example, memory is being cleaned and then added immediately after).  
> > > You can configure the JVM to execute a script on OOM, potentially  
> > > killing  
> > > the service.
> > > 
> > > On Fri, May 4, 2012 at 4:38 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > wrote:
> > > 
> > > > I am able to recover the data.. "there is no data loss" but I have to  
> > > > manually restart the server after OOM.  
> > > > Will post the gist also.
> > > 
> > > > Thanks and Regards  
> > > > Jagdeep
> > > 
> > > > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > 
> > > > > You mean that you get into problems when it runs OOM, and you can't  
> > > > > recover  
> > > > > the data? Can you gist hte OOM failure you get in the logs in this  
> > > > > case?
> > > 
> > > > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<  
> > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > wrote:
> > > 
> > > > > > Yes "java windows 32bit" is a constraint as of now now. Using  
> > > > > > 64bit  
> > > > > > service wrapper is not at all an issue. I am already using it on  
> > > > > > 64  
> > > > > > bit OS but it has only 8 GB RAM.  
> > > > > > I am trying to port to 64bit OS and jvm but it will take some  
> > > > > > time.  
> > > > > > Will have to find an alternate by that time.  
> > > > > > Unattended recovery of ES instances if it goes unresponsive is my  
> > > > > > main  
> > > > > > concern for which I am not able to find appropriate approach.
> > > 
> > > > > > Thanks and Regards  
> > > > > > Jagdeep
> > > 
> > > > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > 
> > > > > > > Are you saying you can only use the java windows 32bit? Is that  
> > > > > > > because  
> > > > > > > thats the only one available in the servicewrapper community  
> > > > > > > edition?  
> > > > > > > Its a  
> > > > > > > shame if thats the case, you could try and use other way to  
> > > > > > > start ES  
> > > > > > > in  
> > > > > > > windows as a service, and use a 64bit JVM, it will be much  
> > > > > > > better  
> > > > > > > than  
> > > > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > > > [Daemon – Daemon : Procrun](http://commons.apache.org/daemon/procrun.html).
> > > 
> > > > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > wrote:
> > > 
> > > > > > > > Thanks Shay for your response.
> > > 
> > > > > > > > I have 2 servers of following configuration  
> > > > > > > > Windows 32 bit  
> > > > > > > > 24 core cpu  
> > > > > > > > 32 GB ram
> > > 
> > > > > > > > Since its windows 32 bit I am not able to allocate more than  
> > > > > > > > 1.5gb  
> > > > > > > > RAM  
> > > > > > > > to one ES instance. I am doing term faceting for which I need  
> > > > > > > > more  
> > > > > > > > memory.  
> > > > > > > > Yes I tried to run several instances of service your your  
> > > > > > > > service  
> > > > > > > > wrapper but unable to do that.  
> > > > > > > > [GitHub - elastic/elasticsearch-servicewrapper: A service wrapper on top of elasticsearch](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > > 
> > > > > > > > I want to control automatic restart if my ES instances if it  
> > > > > > > > goes  
> > > > > > > > unresponsive. Any suggestions for this?
> > > 
> > > > > > > > Thanks and rewgards  
> > > > > > > > Jagdeep
> > > 
> > > > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > 
> > > > > > > > > First, why do you need to run multiple ES instances? You  
> > > > > > > > > don't  
> > > > > > > > > really  
> > > > > > > > > need  
> > > > > > > > > to... . Second, just run several instances of the service,  
> > > > > > > > > or is  
> > > > > > > > > that a  
> > > > > > > > > problem?
> > > 
> > > > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > wrote:
> > > 
> > > > > > > > > > Hi,
> > > 
> > > > > > > > > > I am able to run multiple ES instances on one windows  
> > > > > > > > > > server  
> > > > > > > > > > from  
> > > > > > > > > > bat  
> > > > > > > > > > file.  
> > > > > > > > > > I want to run multiple ES instances through single or  
> > > > > > > > > > multiple  
> > > > > > > > > > ES  
> > > > > > > > > > services.  
> > > > > > > > > > Server configuration:  
> > > > > > > > > > Windows 32 bit  
> > > > > > > > > > 24 core cpu  
> > > > > > > > > > 32 GB ram
> > > 
> > > > > > > > > > I am going to production so this is critical for me.  
> > > > > > > > > > Please  
> > > > > > > > > > help  
> > > > > > > > > > me.
> > > 
> > > > > > > > > > Thanks and Regards  
> > > > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 10, 2012, 9:18pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/15 "2012-05-10T21:18:33Z")

</div>

The master node job is simple, it is responsible to act to cluster wide  
metadata or nodes changes. It will react to things like adding and removing  
a node, or creating deleting an index, by maintaining a single view of the  
global "cluster state".

When you say that you used single master node and multiple data nodes, did  
you send requests to the master node?

The idea of a node balancer node (effectively, a node.client: true node) is  
to simply be a node that is aware of the cluster state (more specifically,  
shard placement). The best usage for it is for clients that use the HTTP  
API connecting to "localhost" that runs the load balancer node, without  
needing to worry about a list of addresses to connect to and handling  
failover.

On Wed, May 9, 2012 at 12:36 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:

> Thanks Shay for your response.
> 
> Ok then I am considering to upgrade my OS to 64 bit so that i can allocate  
> 30 GB to 1 node only.
> 
> _There is one more scenario on same server_ - Earlier we were setting  
> nodes as a combination of master and data, i.e. the  
> default configuration of nodes acting both as master and data. We moved  
> out  
> of that configuration, and now each physical server is installed with 1  
> instance of master node and 1 or more instances of data node. Due to such  
> configuration, some data node might get unresponsive due to OOM, but the  
> master node doesn't suffer the problem, and continue providing responses  
> by  
> gathering results from other data nodes as available.\* In case of  
> multiple \*  
> \*data node failure, results are provided with explicit OOM messages,  
> which \*  
> _is even better._ Using the timeout property in search queries didn't  
> respond  
> as expected, I don't know why, but provided it works, it will give the  
> perfect solution to our problem.
> 
> Can you please explain the detailed task division of master and data  
> nodes, and of the configuration of load-balancer node (neither master nor  
> data). We did not actually find much usage of it in accordance with our  
> setup.
> 
> Thanks and Regards  
> Jagdeep
> 
> On Wednesday, May 9, 2012 2:28:25 PM UTC+5:30, kimchy wrote:
> 
> > Well, OOM in Java is a strange beast, if you don't send any more requests  
> > like the one you posted, which obviously can't be allocated, then the  
> > system will probably recover. But if you continue to send more requests,  
> > you will get into problems with the GC stalling the JVM.
> > 
> > Make sure you run a single node on the machine, and not several (I think  
> > its the same one with the 32bit, which means you are not using the machine  
> > resources properly), and allocate enough nodes to accommodate for it.
> > 
> > On Mon, May 7, 2012 at 6:08 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> > 
> > > Hi Shay,
> > > 
> > > I have copied the log to gist  
> > > [https://gist.github.com/\*\*2627823](https://gist.github.com/**2627823) [https://gist.github.com/2627823](https://gist.github.com/2627823)
> > > 
> > > I am doing the term faceting and oom is expected and accepted for  
> > > that. But system should recover from this, it can't just go  
> > > unresponsive and need manual restart of the server. Please suggest if  
> > > I need to change number of nodes or configuration.
> > > 
> > > Thanks and Regards  
> > > Jagdeep
> > > 
> > > On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > 
> > > > It might be needed, yea. Especially if the memory pressure does not  
> > > > relent  
> > > > (for example, memory is being cleaned and then added immediately  
> > > > after).  
> > > > You can configure the JVM to execute a script on OOM, potentially  
> > > > killing  
> > > > the service.
> > > > 
> > > > On Fri, May 4, 2012 at 4:38 PM, jagdeep singh \<[reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > \*\*wrote:
> > > > 
> > > > > I am able to recover the data.. "there is no data loss" but I have to  
> > > > > manually restart the server after OOM.  
> > > > > Will post the gist also.
> > > > 
> > > > > Thanks and Regards  
> > > > > Jagdeep
> > > > 
> > > > > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > 
> > > > > > You mean that you get into problems when it runs OOM, and you can't  
> > > > > > recover  
> > > > > > the data? Can you gist hte OOM failure you get in the logs in this  
> > > > > > case?
> > > > 
> > > > > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<  
> > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > wrote:
> > > > 
> > > > > > > Yes "java windows 32bit" is a constraint as of now now. Using  
> > > > > > > 64bit  
> > > > > > > service wrapper is not at all an issue. I am already using it on  
> > > > > > > 64  
> > > > > > > bit OS but it has only 8 GB RAM.  
> > > > > > > I am trying to port to 64bit OS and jvm but it will take some  
> > > > > > > time.  
> > > > > > > Will have to find an alternate by that time.  
> > > > > > > Unattended recovery of ES instances if it goes unresponsive is  
> > > > > > > my main  
> > > > > > > concern for which I am not able to find appropriate approach.
> > > > 
> > > > > > > Thanks and Regards  
> > > > > > > Jagdeep
> > > > 
> > > > > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > 
> > > > > > > > Are you saying you can only use the java windows 32bit? Is that  
> > > > > > > > because  
> > > > > > > > thats the only one available in the servicewrapper community  
> > > > > > > > edition?  
> > > > > > > > Its a  
> > > > > > > > shame if thats the case, you could try and use other way to  
> > > > > > > > start ES  
> > > > > > > > in  
> > > > > > > > windows as a service, and use a 64bit JVM, it will be much  
> > > > > > > > better  
> > > > > > > > than  
> > > > > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > > > > [http://commons.apache.org/\*\*daemon/procrun.html](http://commons.apache.org/**daemon/procrun.html)[http://commons.apache.org/daemon/procrun.html](http://commons.apache.org/daemon/procrun.html)  
> > > > > > > > .
> > > > 
> > > > > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > wrote:
> > > > 
> > > > > > > > > Thanks Shay for your response.
> > > > 
> > > > > > > > > I have 2 servers of following configuration  
> > > > > > > > > Windows 32 bit  
> > > > > > > > > 24 core cpu  
> > > > > > > > > 32 GB ram
> > > > 
> > > > > > > > > Since its windows 32 bit I am not able to allocate more than  
> > > > > > > > > 1.5gb  
> > > > > > > > > RAM  
> > > > > > > > > to one ES instance. I am doing term faceting for which I  
> > > > > > > > > need more  
> > > > > > > > > memory.  
> > > > > > > > > Yes I tried to run several instances of service your your  
> > > > > > > > > service  
> > > > > > > > > wrapper but unable to do that.  
> > > > > > > > > [https://github.com/\*\*elasticsearch/elasticsearch-](https://github.com/**elasticsearch/elasticsearch-)\*\*  
> > > > > > > > > servicewrapper[https://github.com/elasticsearch/elasticsearch-servicewrapper](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > > > 
> > > > > > > > > I want to control automatic restart if my ES instances if it  
> > > > > > > > > goes  
> > > > > > > > > unresponsive. Any suggestions for this?
> > > > 
> > > > > > > > > Thanks and rewgards  
> > > > > > > > > Jagdeep
> > > > 
> > > > > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > > 
> > > > > > > > > > First, why do you need to run multiple ES instances? You  
> > > > > > > > > > don't  
> > > > > > > > > > really  
> > > > > > > > > > need  
> > > > > > > > > > to... . Second, just run several instances of the service,  
> > > > > > > > > > or is  
> > > > > > > > > > that a  
> > > > > > > > > > problem?
> > > > 
> > > > > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > > wrote:
> > > > 
> > > > > > > > > > > Hi,
> > > > 
> > > > > > > > > > > I am able to run multiple ES instances on one windows  
> > > > > > > > > > > server  
> > > > > > > > > > > from  
> > > > > > > > > > > bat  
> > > > > > > > > > > file.  
> > > > > > > > > > > I want to run multiple ES instances through single or  
> > > > > > > > > > > multiple  
> > > > > > > > > > > ES  
> > > > > > > > > > > services.  
> > > > > > > > > > > Server configuration:  
> > > > > > > > > > > Windows 32 bit  
> > > > > > > > > > > 24 core cpu  
> > > > > > > > > > > 32 GB ram
> > > > 
> > > > > > > > > > > I am going to production so this is critical for me.  
> > > > > > > > > > > Please  
> > > > > > > > > > > help  
> > > > > > > > > > > me.
> > > > 
> > > > > > > > > > > Thanks and Regards  
> > > > > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![jagdeep](https://avatars.discourse-cdn.com/v4/letter/j/ba8739/32.png) [@jagdeep](https://discuss.elastic.co/u/jagdeep)\
**Post date:** [May 14, 2012, 5:43am UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/16 "2012-05-14T05:43:23Z")

</div>

Sorry for the late response. Missed ur reply ☹

1 master node and multiple data node is working fine as of now. Atleast I  
am not entering into unresponsive state and can manage my nodes after  
checking output from cluster health API. Shard allocation is bit slow in  
this case. Since my master does not consume much memory and never ran oom,  
I am wondering if multiple masters can further improve performance. Please  
suggest.

This scenario can be useful for others too 🙂 atleast for ppl who have ram  
allocation constraint.  
Thanks for all your support.. looking forward for ur Berlinbuzzword talk 🙂

Regards  
Jagdeep

On Friday, May 11, 2012 2:48:33 AM UTC+5:30, kimchy wrote:

> The master node job is simple, it is responsible to act to cluster wide  
> metadata or nodes changes. It will react to things like adding and removing  
> a node, or creating deleting an index, by maintaining a single view of the  
> global "cluster state".
> 
> When you say that you used single master node and multiple data nodes, did  
> you send requests to the master node?
> 
> The idea of a node balancer node (effectively, a node.client: true node)  
> is to simply be a node that is aware of the cluster state (more  
> specifically, shard placement). The best usage for it is for clients that  
> use the HTTP API connecting to "localhost" that runs the load balancer  
> node, without needing to worry about a list of addresses to connect to and  
> handling failover.
> 
> On Wed, May 9, 2012 at 12:36 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> 
> > Thanks Shay for your response.
> > 
> > Ok then I am considering to upgrade my OS to 64 bit so that i can  
> > allocate 30 GB to 1 node only.
> > 
> > _There is one more scenario on same server_ - Earlier we were setting  
> > nodes as a combination of master and data, i.e. the  
> > default configuration of nodes acting both as master and data. We moved  
> > out  
> > of that configuration, and now each physical server is installed with 1  
> > instance of master node and 1 or more instances of data node. Due to such  
> > configuration, some data node might get unresponsive due to OOM, but the  
> > master node doesn't suffer the problem, and continue providing responses  
> > by  
> > gathering results from other data nodes as available.\* In case of  
> > multiple \*  
> > \*data node failure, results are provided with explicit OOM messages,  
> > which \*  
> > _is even better._ Using the timeout property in search queries didn't  
> > respond  
> > as expected, I don't know why, but provided it works, it will give the  
> > perfect solution to our problem.
> > 
> > Can you please explain the detailed task division of master and data  
> > nodes, and of the configuration of load-balancer node (neither master nor  
> > data). We did not actually find much usage of it in accordance with our  
> > setup.
> > 
> > Thanks and Regards  
> > Jagdeep
> > 
> > On Wednesday, May 9, 2012 2:28:25 PM UTC+5:30, kimchy wrote:
> > 
> > > Well, OOM in Java is a strange beast, if you don't send any more  
> > > requests like the one you posted, which obviously can't be allocated, then  
> > > the system will probably recover. But if you continue to send more  
> > > requests, you will get into problems with the GC stalling the JVM.
> > > 
> > > Make sure you run a single node on the machine, and not several (I think  
> > > its the same one with the 32bit, which means you are not using the machine  
> > > resources properly), and allocate enough nodes to accommodate for it.
> > > 
> > > On Mon, May 7, 2012 at 6:08 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> > > 
> > > > Hi Shay,
> > > > 
> > > > I have copied the log to gist  
> > > > [https://gist.github.com/\*\*2627823](https://gist.github.com/**2627823) [https://gist.github.com/2627823](https://gist.github.com/2627823)
> > > > 
> > > > I am doing the term faceting and oom is expected and accepted for  
> > > > that. But system should recover from this, it can't just go  
> > > > unresponsive and need manual restart of the server. Please suggest if  
> > > > I need to change number of nodes or configuration.
> > > > 
> > > > Thanks and Regards  
> > > > Jagdeep
> > > > 
> > > > On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > 
> > > > > It might be needed, yea. Especially if the memory pressure does not  
> > > > > relent  
> > > > > (for example, memory is being cleaned and then added immediately  
> > > > > after).  
> > > > > You can configure the JVM to execute a script on OOM, potentially  
> > > > > killing  
> > > > > the service.
> > > > > 
> > > > > On Fri, May 4, 2012 at 4:38 PM, jagdeep singh \<  
> > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)\>\*\*wrote:
> > > > > 
> > > > > > I am able to recover the data.. "there is no data loss" but I have  
> > > > > > to  
> > > > > > manually restart the server after OOM.  
> > > > > > Will post the gist also.
> > > > > 
> > > > > > Thanks and Regards  
> > > > > > Jagdeep
> > > > > 
> > > > > > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > 
> > > > > > > You mean that you get into problems when it runs OOM, and you  
> > > > > > > can't  
> > > > > > > recover  
> > > > > > > the data? Can you gist hte OOM failure you get in the logs in  
> > > > > > > this case?
> > > > > 
> > > > > > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<  
> > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > wrote:
> > > > > 
> > > > > > > > Yes "java windows 32bit" is a constraint as of now now. Using  
> > > > > > > > 64bit  
> > > > > > > > service wrapper is not at all an issue. I am already using it  
> > > > > > > > on 64  
> > > > > > > > bit OS but it has only 8 GB RAM.  
> > > > > > > > I am trying to port to 64bit OS and jvm but it will take some  
> > > > > > > > time.  
> > > > > > > > Will have to find an alternate by that time.  
> > > > > > > > Unattended recovery of ES instances if it goes unresponsive is  
> > > > > > > > my main  
> > > > > > > > concern for which I am not able to find appropriate approach.
> > > > > 
> > > > > > > > Thanks and Regards  
> > > > > > > > Jagdeep
> > > > > 
> > > > > > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > 
> > > > > > > > > Are you saying you can only use the java windows 32bit? Is  
> > > > > > > > > that  
> > > > > > > > > because  
> > > > > > > > > thats the only one available in the servicewrapper community  
> > > > > > > > > edition?  
> > > > > > > > > Its a  
> > > > > > > > > shame if thats the case, you could try and use other way to  
> > > > > > > > > start ES  
> > > > > > > > > in  
> > > > > > > > > windows as a service, and use a 64bit JVM, it will be much  
> > > > > > > > > better  
> > > > > > > > > than  
> > > > > > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > > > > > [http://commons.apache.org/\*\*daemon/procrun.html](http://commons.apache.org/**daemon/procrun.html)[http://commons.apache.org/daemon/procrun.html](http://commons.apache.org/daemon/procrun.html)  
> > > > > > > > > .
> > > > > 
> > > > > > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > wrote:
> > > > > 
> > > > > > > > > > Thanks Shay for your response.
> > > > > 
> > > > > > > > > > I have 2 servers of following configuration  
> > > > > > > > > > Windows 32 bit  
> > > > > > > > > > 24 core cpu  
> > > > > > > > > > 32 GB ram
> > > > > 
> > > > > > > > > > Since its windows 32 bit I am not able to allocate more  
> > > > > > > > > > than 1.5gb  
> > > > > > > > > > RAM  
> > > > > > > > > > to one ES instance. I am doing term faceting for which I  
> > > > > > > > > > need more  
> > > > > > > > > > memory.  
> > > > > > > > > > Yes I tried to run several instances of service your your  
> > > > > > > > > > service  
> > > > > > > > > > wrapper but unable to do that.  
> > > > > > > > > > [https://github.com/\*\*elasticsearch/elasticsearch-](https://github.com/**elasticsearch/elasticsearch-)\*\*  
> > > > > > > > > > servicewrapper[https://github.com/elasticsearch/elasticsearch-servicewrapper](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > > > > 
> > > > > > > > > > I want to control automatic restart if my ES instances if  
> > > > > > > > > > it goes  
> > > > > > > > > > unresponsive. Any suggestions for this?
> > > > > 
> > > > > > > > > > Thanks and rewgards  
> > > > > > > > > > Jagdeep
> > > > > 
> > > > > > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > > > 
> > > > > > > > > > > First, why do you need to run multiple ES instances? You  
> > > > > > > > > > > don't  
> > > > > > > > > > > really  
> > > > > > > > > > > need  
> > > > > > > > > > > to... . Second, just run several instances of the  
> > > > > > > > > > > service, or is  
> > > > > > > > > > > that a  
> > > > > > > > > > > problem?
> > > > > 
> > > > > > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > > > wrote:
> > > > > 
> > > > > > > > > > > > Hi,
> > > > > 
> > > > > > > > > > > > I am able to run multiple ES instances on one windows  
> > > > > > > > > > > > server  
> > > > > > > > > > > > from  
> > > > > > > > > > > > bat  
> > > > > > > > > > > > file.  
> > > > > > > > > > > > I want to run multiple ES instances through single or  
> > > > > > > > > > > > multiple  
> > > > > > > > > > > > ES  
> > > > > > > > > > > > services.  
> > > > > > > > > > > > Server configuration:  
> > > > > > > > > > > > Windows 32 bit  
> > > > > > > > > > > > 24 core cpu  
> > > > > > > > > > > > 32 GB ram
> > > > > 
> > > > > > > > > > > > I am going to production so this is critical for me.  
> > > > > > > > > > > > Please  
> > > > > > > > > > > > help  
> > > > > > > > > > > > me.
> > > > > 
> > > > > > > > > > > > Thanks and Regards  
> > > > > > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 15, 2012, 8:33pm UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/17 "2012-05-15T20:33:54Z")

</div>

Heya, more "master eligible nodes" won't change things, since one effective  
master node is elected and then used. Having a separate master node does  
not really affect the perf of shard allocation..., the master node simply  
decides that a shard should go to node X, and possibly recover its state  
from a shard on node Y, then, the recovery happens from node X to node Y,  
without the master being in the "middle".

On Mon, May 14, 2012 at 8:43 AM, jagdeep [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com) wrote:

> Sorry for the late response. Missed ur reply ☹
> 
> 1 master node and multiple data node is working fine as of now. Atleast I  
> am not entering into unresponsive state and can manage my nodes after  
> checking output from cluster health API. Shard allocation is bit slow in  
> this case. Since my master does not consume much memory and never ran oom,  
> I am wondering if multiple masters can further improve performance. Please  
> suggest.
> 
> This scenario can be useful for others too 🙂 atleast for ppl who have ram  
> allocation constraint.  
> Thanks for all your support.. looking forward for ur Berlinbuzzword talk 🙂
> 
> Regards  
> Jagdeep
> 
> On Friday, May 11, 2012 2:48:33 AM UTC+5:30, kimchy wrote:
> 
> > The master node job is simple, it is responsible to act to cluster wide  
> > metadata or nodes changes. It will react to things like adding and removing  
> > a node, or creating deleting an index, by maintaining a single view of the  
> > global "cluster state".
> > 
> > When you say that you used single master node and multiple data nodes,  
> > did you send requests to the master node?
> > 
> > The idea of a node balancer node (effectively, a node.client: true node)  
> > is to simply be a node that is aware of the cluster state (more  
> > specifically, shard placement). The best usage for it is for clients that  
> > use the HTTP API connecting to "localhost" that runs the load balancer  
> > node, without needing to worry about a list of addresses to connect to and  
> > handling failover.
> > 
> > On Wed, May 9, 2012 at 12:36 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> > 
> > > Thanks Shay for your response.
> > > 
> > > Ok then I am considering to upgrade my OS to 64 bit so that i can  
> > > allocate 30 GB to 1 node only.
> > > 
> > > _There is one more scenario on same server_ - Earlier we were setting  
> > > nodes as a combination of master and data, i.e. the  
> > > default configuration of nodes acting both as master and data. We moved  
> > > out  
> > > of that configuration, and now each physical server is installed with 1  
> > > instance of master node and 1 or more instances of data node. Due to  
> > > such  
> > > configuration, some data node might get unresponsive due to OOM, but the  
> > > master node doesn't suffer the problem, and continue providing responses  
> > > by  
> > > gathering results from other data nodes as available.\* In case of  
> > > multiple \*  
> > > \*data node failure, results are provided with explicit OOM messages,  
> > > which \*  
> > > _is even better._ Using the timeout property in search queries didn't  
> > > respond  
> > > as expected, I don't know why, but provided it works, it will give the  
> > > perfect solution to our problem.
> > > 
> > > Can you please explain the detailed task division of master and data  
> > > nodes, and of the configuration of load-balancer node (neither master  
> > > nor  
> > > data). We did not actually find much usage of it in accordance with our  
> > > setup.
> > > 
> > > Thanks and Regards  
> > > Jagdeep
> > > 
> > > On Wednesday, May 9, 2012 2:28:25 PM UTC+5:30, kimchy wrote:
> > > 
> > > > Well, OOM in Java is a strange beast, if you don't send any more  
> > > > requests like the one you posted, which obviously can't be allocated, then  
> > > > the system will probably recover. But if you continue to send more  
> > > > requests, you will get into problems with the GC stalling the JVM.
> > > > 
> > > > Make sure you run a single node on the machine, and not several (I  
> > > > think its the same one with the 32bit, which means you are not using the  
> > > > machine resources properly), and allocate enough nodes to accommodate for  
> > > > it.
> > > > 
> > > > On Mon, May 7, 2012 at 6:08 PM, jagdeep singh [reach.jagdeep@gmail.com](mailto:reach.jagdeep@gmail.com)wrote:
> > > > 
> > > > > Hi Shay,
> > > > > 
> > > > > I have copied the log to gist  
> > > > > [https://gist.github.com/\*\*262782\*\*3](https://gist.github.com/ **262782** 3) [https://gist.github.com/2627823](https://gist.github.com/2627823)
> > > > > 
> > > > > I am doing the term faceting and oom is expected and accepted for  
> > > > > that. But system should recover from this, it can't just go  
> > > > > unresponsive and need manual restart of the server. Please suggest if  
> > > > > I need to change number of nodes or configuration.
> > > > > 
> > > > > Thanks and Regards  
> > > > > Jagdeep
> > > > > 
> > > > > On May 4, 6:47 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > 
> > > > > > It might be needed, yea. Especially if the memory pressure does not  
> > > > > > relent  
> > > > > > (for example, memory is being cleaned and then added immediately  
> > > > > > after).  
> > > > > > You can configure the JVM to execute a script on OOM, potentially  
> > > > > > killing  
> > > > > > the service.
> > > > > > 
> > > > > > On Fri, May 4, 2012 at 4:38 PM, jagdeep singh \<  
> > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)\> **wrote** :
> > > > > > 
> > > > > > > I am able to recover the data.. "there is no data loss" but I have  
> > > > > > > to  
> > > > > > > manually restart the server after OOM.  
> > > > > > > Will post the gist also.
> > > > > > 
> > > > > > > Thanks and Regards  
> > > > > > > Jagdeep
> > > > > > 
> > > > > > > On May 4, 6:13 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > 
> > > > > > > > You mean that you get into problems when it runs OOM, and you  
> > > > > > > > can't  
> > > > > > > > recover  
> > > > > > > > the data? Can you gist hte OOM failure you get in the logs in  
> > > > > > > > this case?
> > > > > > 
> > > > > > > > On Thu, May 3, 2012 at 8:14 AM, jagdeep singh \<  
> > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > wrote:
> > > > > > 
> > > > > > > > > Yes "java windows 32bit" is a constraint as of now now. Using  
> > > > > > > > > 64bit  
> > > > > > > > > service wrapper is not at all an issue. I am already using it  
> > > > > > > > > on 64  
> > > > > > > > > bit OS but it has only 8 GB RAM.  
> > > > > > > > > I am trying to port to 64bit OS and jvm but it will take some  
> > > > > > > > > time.  
> > > > > > > > > Will have to find an alternate by that time.  
> > > > > > > > > Unattended recovery of ES instances if it goes unresponsive is  
> > > > > > > > > my main  
> > > > > > > > > concern for which I am not able to find appropriate approach.
> > > > > > 
> > > > > > > > > Thanks and Regards  
> > > > > > > > > Jagdeep
> > > > > > 
> > > > > > > > > On May 2, 9:49 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > > 
> > > > > > > > > > Are you saying you can only use the java windows 32bit? Is  
> > > > > > > > > > that  
> > > > > > > > > > because  
> > > > > > > > > > thats the only one available in the servicewrapper community  
> > > > > > > > > > edition?  
> > > > > > > > > > Its a  
> > > > > > > > > > shame if thats the case, you could try and use other way to  
> > > > > > > > > > start ES  
> > > > > > > > > > in  
> > > > > > > > > > windows as a service, and use a 64bit JVM, it will be much  
> > > > > > > > > > better  
> > > > > > > > > > than  
> > > > > > > > > > starting 10 instances of ES.... . Maybe try this:  
> > > > > > > > > > [http://commons.apache.org/\*\*dae\*\*mon/procrun.html](http://commons.apache.org/ **dae** mon/procrun.html)[http://commons.apache.org/daemon/procrun.html](http://commons.apache.org/daemon/procrun.html)  
> > > > > > > > > > .
> > > > > > 
> > > > > > > > > > On Wed, May 2, 2012 at 7:39 PM, jagdeep singh \<  
> > > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > > wrote:
> > > > > > 
> > > > > > > > > > > Thanks Shay for your response.
> > > > > > 
> > > > > > > > > > > I have 2 servers of following configuration  
> > > > > > > > > > > Windows 32 bit  
> > > > > > > > > > > 24 core cpu  
> > > > > > > > > > > 32 GB ram
> > > > > > 
> > > > > > > > > > > Since its windows 32 bit I am not able to allocate more  
> > > > > > > > > > > than 1.5gb  
> > > > > > > > > > > RAM  
> > > > > > > > > > > to one ES instance. I am doing term faceting for which I  
> > > > > > > > > > > need more  
> > > > > > > > > > > memory.  
> > > > > > > > > > > Yes I tried to run several instances of service your your  
> > > > > > > > > > > service  
> > > > > > > > > > > wrapper but unable to do that.  
> > > > > > > > > > > [https://github.com/\*\*elasticsea\*\*rch/elasticsearch-](https://github.com/ **elasticsea** rch/elasticsearch-)\*\*  
> > > > > > > > > > > servicewrapp\*\*er[https://github.com/elasticsearch/elasticsearch-servicewrapper](https://github.com/elasticsearch/elasticsearch-servicewrapper)
> > > > > > 
> > > > > > > > > > > I want to control automatic restart if my ES instances if  
> > > > > > > > > > > it goes  
> > > > > > > > > > > unresponsive. Any suggestions for this?
> > > > > > 
> > > > > > > > > > > Thanks and rewgards  
> > > > > > > > > > > Jagdeep
> > > > > > 
> > > > > > > > > > > On May 2, 9:28 pm, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote:
> > > > > > > > > > > 
> > > > > > > > > > > > First, why do you need to run multiple ES instances? You  
> > > > > > > > > > > > don't  
> > > > > > > > > > > > really  
> > > > > > > > > > > > need  
> > > > > > > > > > > > to... . Second, just run several instances of the  
> > > > > > > > > > > > service, or is  
> > > > > > > > > > > > that a  
> > > > > > > > > > > > problem?
> > > > > > 
> > > > > > > > > > > > On Tue, May 1, 2012 at 5:11 PM, jagdeep singh \<  
> > > > > > > > > > > > [reach.jagd...@gmail.com](mailto:reach.jagd...@gmail.com)  
> > > > > > > > > > > > wrote:
> > > > > > 
> > > > > > > > > > > > > Hi,
> > > > > > 
> > > > > > > > > > > > > I am able to run multiple ES instances on one windows  
> > > > > > > > > > > > > server  
> > > > > > > > > > > > > from  
> > > > > > > > > > > > > bat  
> > > > > > > > > > > > > file.  
> > > > > > > > > > > > > I want to run multiple ES instances through single or  
> > > > > > > > > > > > > multiple  
> > > > > > > > > > > > > ES  
> > > > > > > > > > > > > services.  
> > > > > > > > > > > > > Server configuration:  
> > > > > > > > > > > > > Windows 32 bit  
> > > > > > > > > > > > > 24 core cpu  
> > > > > > > > > > > > > 32 GB ram
> > > > > > 
> > > > > > > > > > > > > I am going to production so this is critical for me.  
> > > > > > > > > > > > > Please  
> > > > > > > > > > > > > help  
> > > > > > > > > > > > > me.
> > > > > > 
> > > > > > > > > > > > > Thanks and Regards  
> > > > > > > > > > > > > Jagdeep

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:28am UTC](https://discuss.elastic.co/t/starting-multiple-es-instances-on-one-physical-server/7523/18 "2017-07-06T03:28:42Z")

</div>