Adding new nodes


(optimusprime) #1

I'm not entirely sure how discovery in ES works. Are there resources out there that detail it? How can I dynamically add a new node (on a different physical machine) to an existing cluster. I tried looking at some previous posts in this forum. I get the idea that one's supposed to list nodes in the config file and they discover each other. But that doesn't quite explain dynamic addition of nodes and load balancing.

On the same lines, is the master elected or configured? Does the master use more resources than data nodes? Because in the latter case, I would like to have a machine with more physical resources be the master.


(Shay Banon) #2

On Sat, Aug 13, 2011 at 11:02 PM, optimusprime usmasood@gmail.com wrote:

I'm not entirely sure how discovery in ES works. Are there resources out
there that detail it? How can I dynamically add a new node (on a different
physical machine) to an existing cluster. I tried looking at some previous
posts in this forum. I get the idea that one's supposed to list nodes in
the
config file and they discover each other. But that doesn't quite explain
dynamic addition of nodes and load balancing.

Discovery is explained here:
http://www.elasticsearch.org/guide/reference/modules/discovery/.

On the same lines, is the master elected or configured? Does the master use
more resources than data nodes? Because in the latter case, I would like to
have a machine with more physical resources be the master.

Master is automatically elected, but it does not require more resources. You
can control which nodes will can become master nodes though.

--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3252115.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


(optimusprime) #3

So if I understand Zen unicast discovery right, we have elasticsearch
running on a set of nodes with fixed IPs (gossip routers). Any new node
talks to these nodes first to "register" itself as part of the cluster.
Client nodes can obtain the master node (or data nodes) from the cluster by
talking to one of these routers. Needless to say at least one of the gossip
routers must be up at all times, otherwise discovery fails. Can we
dynamically add more gossip routers or would that require us to shutdown the
node, update its config file and restart it?

Usman

On Tue, Aug 16, 2011 at 4:09 AM, kimchy [via ElasticSearch Users] <
ml-node+3258336-1762007821-421811@n3.nabble.com> wrote:

On Sat, Aug 13, 2011 at 11:02 PM, optimusprime <[hidden email]http://user/SendEmail.jtp?type=node&node=3258336&i=0

wrote:

I'm not entirely sure how discovery in ES works. Are there resources out
there that detail it? How can I dynamically add a new node (on a different
physical machine) to an existing cluster. I tried looking at some previous
posts in this forum. I get the idea that one's supposed to list nodes in
the
config file and they discover each other. But that doesn't quite explain
dynamic addition of nodes and load balancing.

Discovery is explained here:
http://www.elasticsearch.org/guide/reference/modules/discovery/.

On the same lines, is the master elected or configured? Does the master
use
more resources than data nodes? Because in the latter case, I would like
to
have a machine with more physical resources be the master.

Master is automatically elected, but it does not require more resources.
You can control which nodes will can become master nodes though.

--

View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3252115.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


If you reply to this email, your message will be added to the discussion
below:

http://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3258336.html
To unsubscribe from Adding new nodes, click herehttp://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3252115&code=dXNtYXNvb2RAZ21haWwuY29tfDMyNTIxMTV8LTE2MzM1MTU2MDg=.


(Shay Banon) #4

Currently, you have to bring down a node in order to update its list of
"seed" IPs. Though you can add new machines to new nodes you bring into the
cluster.

On Tue, Aug 16, 2011 at 3:36 PM, optimusprime usmasood@gmail.com wrote:

So if I understand Zen unicast discovery right, we have elasticsearch
running on a set of nodes with fixed IPs (gossip routers). Any new node
talks to these nodes first to "register" itself as part of the cluster.
Client nodes can obtain the master node (or data nodes) from the cluster by
talking to one of these routers. Needless to say at least one of the gossip
routers must be up at all times, otherwise discovery fails. Can we
dynamically add more gossip routers or would that require us to shutdown the
node, update its config file and restart it?

Usman

On Tue, Aug 16, 2011 at 4:09 AM, kimchy [via ElasticSearch Users] <[hidden
email] http://user/SendEmail.jtp?type=node&node=3258502&i=0> wrote:

On Sat, Aug 13, 2011 at 11:02 PM, optimusprime <[hidden email]http://user/SendEmail.jtp?type=node&node=3258336&i=0

wrote:

I'm not entirely sure how discovery in ES works. Are there resources out
there that detail it? How can I dynamically add a new node (on a
different
physical machine) to an existing cluster. I tried looking at some
previous
posts in this forum. I get the idea that one's supposed to list nodes in
the
config file and they discover each other. But that doesn't quite explain
dynamic addition of nodes and load balancing.

Discovery is explained here:
http://www.elasticsearch.org/guide/reference/modules/discovery/.

On the same lines, is the master elected or configured? Does the master
use
more resources than data nodes? Because in the latter case, I would like
to
have a machine with more physical resources be the master.

Master is automatically elected, but it does not require more resources.
You can control which nodes will can become master nodes though.

--

View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3252115.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


If you reply to this email, your message will be added to the discussion
below:

http://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3258336.html
To unsubscribe from Adding new nodes, click here.


View this message in context: Re: Adding new nodeshttp://elasticsearch-users.115913.n3.nabble.com/Adding-new-nodes-tp3252115p3258502.html

Sent from the ElasticSearch Users mailing list archivehttp://elasticsearch-users.115913.n3.nabble.com/at Nabble.com.


(system) #5