# Running Multiple Clusters On One Host **URL:** \ **Category:** Elasticsearch\ **Created:** [July 29, 2011, 2:27am UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995 "2011-07-29T02:27:11Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Ed\_Brown\_VSTI](https://avatars.discourse-cdn.com/v4/letter/e/77aa72/32.png) [@Ed\_Brown\_VSTI](https://discuss.elastic.co/u/Ed_Brown_VSTI)\ **Post date:** [July 29, 2011, 2:27am UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/1 "2011-07-29T02:27:11Z")
I'm investigating Elasticsearch and would like to run multiple Elasticsearch clusters on one host. The first cluster is started up using the default setting except for memory minimum and maxium. The second cluster, which I don't want to join the first cluster, is started with the command line: ./bin/elasticsearch -f -Des.http.port=14000 - Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ elasticsearch.yml The output is as follows: === Start Output === [2011-07-28 21:55:01,265][INFO][node] [Tempest] {elasticsearch/0.17.1}[9478]: initializing ... [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] loaded [], sites [] [2011-07-28 21:55:03,992][INFO][node] [Tempest] {elasticsearch/0.17.1}[9478]: initialized [2011-07-28 21:55:03,993][INFO][node] [Tempest] {elasticsearch/0.17.1}[9478]: starting ... [2011-07-28 21:55:04,247][INFO][transport] [Tempest] bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ 192.168.11.124:9400]} [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ 192.168.11.124:9301]],}, reason: zen-disco-receive(from master [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] vsti/jwJZAL5dQSOM9eRITJmYpQ [2011-07-28 21:55:08,223][INFO][http] [Tempest] bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ 192.168.11.124:14000]} [2011-07-28 21:55:08,223][INFO][node] [Tempest] {elasticsearch/0.17.1}[9478]: started === End Output === Note the joining of the cluster that is already running. I don't want it to do that. How do I configure the second cluster? Below is my elasticsearch.yaml file. Note: The cluster name is different from the cluster name of the first instance: === Start Configuration === # The cluster name cluster: name: inst2-vsti # Path Settings path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml path.data: /opt/elasticsearch/data-iscsi path.work: /opt/elasticsearch/inst2-work path.logs: /opt/elasticsearch/inst2-logs network: host: 192.168.11.124 === End Configuration === Your help is appreciated. Ed Brown ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [July 29, 2011, 4:12am UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/2 "2011-07-29T04:12:39Z")
When I launch multiple instances on the same node, I use two differents ES installations : One in /es1 Second in /es2 So I'm really sure that data dirs are not shared. I'm wondering if you use elasticsearch.yaml or elasticsearch.yml for your second config file. I think that your second instance doesn't read your second config file and have the default cluster name. When you connect to second node with curl, what cluster name does it show ? David 😉 Le 29 juil. 2011 à 04:27, Ed Brown VSTI [edbrownvsti@gmail.com](mailto:edbrownvsti@gmail.com) a écrit : > I'm investigating Elasticsearch and would like to run multiple > Elasticsearch clusters on one host. > > The first cluster is started up using the default setting except for > memory minimum and maxium. > > The second cluster, which I don't want to join the first cluster, is > started with the command line: > > ./bin/elasticsearch -f -Des.http.port=14000 - > Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ > elasticsearch.yml > > The output is as follows: > > === Start Output === > > [2011-07-28 21:55:01,265][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: initializing ... > [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] > loaded , sites > [2011-07-28 21:55:03,992][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: initialized > [2011-07-28 21:55:03,993][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: starting ... > [2011-07-28 21:55:04,247][INFO][transport] [Tempest] > bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ > 192.168.11.124:9400]} > [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] > detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ > 192.168.11.124:9301]],}, reason: zen-disco-receive(from master > [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) > [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] > vsti/jwJZAL5dQSOM9eRITJmYpQ > [2011-07-28 21:55:08,223][INFO][http] [Tempest] > bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ > 192.168.11.124:14000]} > [2011-07-28 21:55:08,223][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: started > > === End Output === > > Note the joining of the cluster that is already running. I don't want > it to do that. How do I configure the second cluster? > > Below is my elasticsearch.yaml file. Note: The cluster name is > different from the cluster name of the first instance: > > === Start Configuration === > > # The cluster name > > cluster: > name: inst2-vsti > > # Path Settings > > path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml > path.data: /opt/elasticsearch/data-iscsi > path.work: /opt/elasticsearch/inst2-work > path.logs: /opt/elasticsearch/inst2-logs > > network: > host: 192.168.11.124 > > === End Configuration === > > Your help is appreciated. > > Ed Brown ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 29, 2011, 6:25am UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/3 "2011-07-29T06:25:52Z")
You need to set different cluster names for the different clusters, so they won't join. Also, if you have a close look at the data directory, you will see that the first directory created is the cluster name, and under it the data for that cluster is stored. On Fri, Jul 29, 2011 at 5:27 AM, Ed Brown VSTI [edbrownvsti@gmail.com](mailto:edbrownvsti@gmail.com)wrote: > I'm investigating Elasticsearch and would like to run multiple > Elasticsearch clusters on one host. > > The first cluster is started up using the default setting except for > memory minimum and maxium. > > The second cluster, which I don't want to join the first cluster, is > started with the command line: > > ./bin/elasticsearch -f -Des.http.port=14000 - > Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ > elasticsearch.yml > > The output is as follows: > > === Start Output === > > [2011-07-28 21:55:01,265][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: initializing ... > [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] > loaded , sites > [2011-07-28 21:55:03,992][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: initialized > [2011-07-28 21:55:03,993][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: starting ... > [2011-07-28 21:55:04,247][INFO][transport] [Tempest] > bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ > 192.168.11.124:9400]} > [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] > detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ > 192.168.11.124:9301]],}, reason: zen-disco-receive(from master > [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) > [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] > vsti/jwJZAL5dQSOM9eRITJmYpQ > [2011-07-28 21:55:08,223][INFO][http] [Tempest] > bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ > 192.168.11.124:14000]} > [2011-07-28 21:55:08,223][INFO][node] [Tempest] > {elasticsearch/0.17.1}[9478]: started > > === End Output === > > Note the joining of the cluster that is already running. I don't want > it to do that. How do I configure the second cluster? > > Below is my elasticsearch.yaml file. Note: The cluster name is > different from the cluster name of the first instance: > > === Start Configuration === > > # The cluster name > > cluster: > name: inst2-vsti > > # Path Settings > > path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml > path.data: /opt/elasticsearch/data-iscsi > path.work: /opt/elasticsearch/inst2-work > path.logs: /opt/elasticsearch/inst2-logs > > network: > host: 192.168.11.124 > > === End Configuration === > > Your help is appreciated. > > Ed Brown ---
**Author:** ![Ed\_Brown\_VSTI](https://avatars.discourse-cdn.com/v4/letter/e/77aa72/32.png) [@Ed\_Brown\_VSTI](https://discuss.elastic.co/u/Ed_Brown_VSTI)\ **Post date:** [July 29, 2011, 2:42pm UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/4 "2011-07-29T14:42:59Z")
On Jul 29, 2:25 am, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote: > You need to set different cluster names for the different clusters, so they > won't join. I definitely have different cluster names. > Also, if you have a close look at the data directory, you will > see that the first directory created is the cluster name, and under it the > data for that cluster is stored. The appropriate data directories were used. I tried creating a second instance from a second installation of Elasticsearch and it worked. I don't have the time to investigate further, but I'll come back to it. > On Fri, Jul 29, 2011 at 5:27 AM, Ed Brown VSTI [edbrownv...@gmail.com](mailto:edbrownv...@gmail.com)wrote: > > > I'm investigating Elasticsearch and would like to run multiple > > Elasticsearch clusters on one host. > > > The first cluster is started up using the default setting except for > > memory minimum and maxium. > > > The second cluster, which I don't want to join the first cluster, is > > started with the command line: > > > ./bin/elasticsearch -f -Des.http.port=14000 - > > Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ > > elasticsearch.yml > > > The output is as follows: > > > === Start Output === > > > [2011-07-28 21:55:01,265][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: initializing ... > > [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] > > loaded , sites > > [2011-07-28 21:55:03,992][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: initialized > > [2011-07-28 21:55:03,993][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: starting ... > > [2011-07-28 21:55:04,247][INFO][transport] [Tempest] > > bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ > > 192.168.11.124:9400]} > > [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] > > detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ > > 192.168.11.124:9301]],}, reason: zen-disco-receive(from master > > [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) > > [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] > > vsti/jwJZAL5dQSOM9eRITJmYpQ > > [2011-07-28 21:55:08,223][INFO][http] [Tempest] > > bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ > > 192.168.11.124:14000]} > > [2011-07-28 21:55:08,223][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: started > > > === End Output === > > > Note the joining of the cluster that is already running. I don't want > > it to do that. How do I configure the second cluster? > > > Below is my elasticsearch.yaml file. Note: The cluster name is > > different from the cluster name of the first instance: > > > === Start Configuration === > > > # The cluster name > > > > cluster: > > name: inst2-vsti > > > # Path Settings > > > > path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml > > path.data: /opt/elasticsearch/data-iscsi > > path.work: /opt/elasticsearch/inst2-work > > path.logs: /opt/elasticsearch/inst2-logs > > > network: > > host: 192.168.11.124 > > > === End Configuration === > > > Your help is appreciated. > > > Ed Brown- Hide quoted text - > > - Show quoted text - ---
**Author:** ![Ed\_Brown\_VSTI](https://avatars.discourse-cdn.com/v4/letter/e/77aa72/32.png) [@Ed\_Brown\_VSTI](https://discuss.elastic.co/u/Ed_Brown_VSTI)\ **Post date:** [July 29, 2011, 2:43pm UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/5 "2011-07-29T14:43:28Z")
On Jul 29, 12:12 am, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > When I launch multiple instances on the same node, I use two differents ES installations : > > One in /es1 > Second in /es2 That's what I just did and it worked. Thanks. I'll come back to my original problem when I have more time. > So I'm really sure that data dirs are not shared. > > I'm wondering if you use elasticsearch.yaml or elasticsearch.yml for your second config file. > > I think that your second instance doesn't read your second config file and have the default cluster name. > > When you connect to second node with curl, what cluster name does it show ? > > David 😉 > > Le 29 juil. 2011 à 04:27, Ed Brown VSTI [edbrownv...@gmail.com](mailto:edbrownv...@gmail.com) a écrit : > > > I'm investigating Elasticsearch and would like to run multiple > > Elasticsearch clusters on one host. > > > The first cluster is started up using the default setting except for > > memory minimum and maxium. > > > The second cluster, which I don't want to join the first cluster, is > > started with the command line: > > > ./bin/elasticsearch -f -Des.http.port=14000 - > > Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ > > elasticsearch.yml > > > The output is as follows: > > > === Start Output === > > > [2011-07-28 21:55:01,265][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: initializing ... > > [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] > > loaded , sites > > [2011-07-28 21:55:03,992][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: initialized > > [2011-07-28 21:55:03,993][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: starting ... > > [2011-07-28 21:55:04,247][INFO][transport] [Tempest] > > bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ > > 192.168.11.124:9400]} > > [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] > > detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ > > 192.168.11.124:9301]],}, reason: zen-disco-receive(from master > > [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) > > [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] > > vsti/jwJZAL5dQSOM9eRITJmYpQ > > [2011-07-28 21:55:08,223][INFO][http] [Tempest] > > bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ > > 192.168.11.124:14000]} > > [2011-07-28 21:55:08,223][INFO][node] [Tempest] > > {elasticsearch/0.17.1}[9478]: started > > > === End Output === > > > Note the joining of the cluster that is already running. I don't want > > it to do that. How do I configure the second cluster? > > > Below is my elasticsearch.yaml file. Note: The cluster name is > > different from the cluster name of the first instance: > > > === Start Configuration === > > > # The cluster name > > > > cluster: > > name: inst2-vsti > > > # Path Settings > > > > path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml > > path.data: /opt/elasticsearch/data-iscsi > > path.work: /opt/elasticsearch/inst2-work > > path.logs: /opt/elasticsearch/inst2-logs > > > network: > > host: 192.168.11.124 > > > === End Configuration === > > > Your help is appreciated. > > > Ed Brown- Hide quoted text - > > - Show quoted text - ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 29, 2011, 3:09pm UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/6 "2011-07-29T15:09:39Z")
I think it ended up using the same configuration file. When elasticsearch starts up, it prints the cluster name it belongs to, for example: [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] vsti/jwJZAL5dQSOM9eRITJmYpQ On Fri, Jul 29, 2011 at 5:42 PM, Ed Brown VSTI [edbrownvsti@gmail.com](mailto:edbrownvsti@gmail.com)wrote: > On Jul 29, 2:25 am, Shay Banon [kim...@gmail.com](mailto:kim...@gmail.com) wrote: > > > You need to set different cluster names for the different clusters, so > > they > > won't join. > > I definitely have different cluster names. > > > Also, if you have a close look at the data directory, you will > > see that the first directory created is the cluster name, and under it > > the > > data for that cluster is stored. > > The appropriate data directories were used. > > I tried creating a second instance from a second installation of > Elasticsearch and it worked. I don't have the time to investigate > further, but I'll come back to it. > > > On Fri, Jul 29, 2011 at 5:27 AM, Ed Brown VSTI \<[edbrownv...@gmail.com](mailto:edbrownv...@gmail.com) > > wrote: > > > > > I'm investigating Elasticsearch and would like to run multiple > > > Elasticsearch clusters on one host. > > > > > The first cluster is started up using the default setting except for > > > memory minimum and maxium. > > > > > The second cluster, which I don't want to join the first cluster, is > > > started with the command line: > > > > > ./bin/elasticsearch -f -Des.http.port=14000 - > > > Des.transport.tcp.port=9400 -Dpath.conf=./inst2-config/ > > > elasticsearch.yml > > > > > The output is as follows: > > > > > === Start Output === > > > > > [2011-07-28 21:55:01,265][INFO][node] [Tempest] > > > {elasticsearch/0.17.1}[9478]: initializing ... > > > [2011-07-28 21:55:01,274][INFO][plugins] [Tempest] > > > loaded , sites > > > [2011-07-28 21:55:03,992][INFO][node] [Tempest] > > > {elasticsearch/0.17.1}[9478]: initialized > > > [2011-07-28 21:55:03,993][INFO][node] [Tempest] > > > {elasticsearch/0.17.1}[9478]: starting ... > > > [2011-07-28 21:55:04,247][INFO][transport] [Tempest] > > > bound\_address {inet[/192.168.11.124:9400]}, publish\_address {inet[/ > > > 192.168.11.124:9400]} > > > [2011-07-28 21:55:07,517][INFO][cluster.service] [Tempest] > > > detected\_master [Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > > 192.168.11.124:9300]], added {[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/ > > > 192.168.11.124:9300]],[Leonus][havEfAcSTD-IITC1nJZ7qw][inet[/ > > > 192.168.11.124:9301]],}, reason: zen-disco-receive(from master > > > [[Optoman][F6i3jzo7QhG1Z2ryUemsMg][inet[/192.168.11.124:9300]]]) > > > [2011-07-28 21:55:08,214][INFO][discovery] [Tempest] > > > vsti/jwJZAL5dQSOM9eRITJmYpQ > > > [2011-07-28 21:55:08,223][INFO][http] [Tempest] > > > bound\_address {inet[/192.168.11.124:14000]}, publish\_address {inet[/ > > > 192.168.11.124:14000]} > > > [2011-07-28 21:55:08,223][INFO][node] [Tempest] > > > {elasticsearch/0.17.1}[9478]: started > > > > > === End Output === > > > > > Note the joining of the cluster that is already running. I don't want > > > it to do that. How do I configure the second cluster? > > > > > Below is my elasticsearch.yaml file. Note: The cluster name is > > > different from the cluster name of the first instance: > > > > > === Start Configuration === > > > > > # The cluster name > > > > > > cluster: > > > name: inst2-vsti > > > > > # Path Settings > > > > > > path.conf: /opt/elasticsearch/inst2-config/elasticsearch.yml > > > path.data: /opt/elasticsearch/data-iscsi > > > path.work: /opt/elasticsearch/inst2-work > > > path.logs: /opt/elasticsearch/inst2-logs > > > > > network: > > > host: 192.168.11.124 > > > > > === End Configuration === > > > > > Your help is appreciated. > > > > > Ed Brown- Hide quoted text - > > > > - Show quoted text - ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:58am UTC](https://discuss.elastic.co/t/running-multiple-clusters-on-one-host/4995/7 "2017-07-06T03:58:50Z")