When new ES worker nodes are created?


(Piotr Jacewicz) #1

Hi,

Recently I have found out that on one of the servers my ES create
additional node few days after launch, then one more 2 days later. ES on
this host was alone node not connected to any cluster. I have already found
out that these are worker nodes and number of all nodes on this host is
exact equivalent of max number of nodes per host . They were created
exactly at midnight. From logs I see that it's right before performing
daily reindexing from DB (about 2000 docs, so tiny number).

I've got some questions related to that for which I couldn't google the
answer:

  1. What could cause these nodes to be created (and what usually is the
    cause - is there any documentation about that)? Was that reindexing init?
    (actual reindexing is logged after creating a node)
  2. Does number of nodes shrink under any circumstances?

I'm wondering ... that host was almost completely idle and only daily
reindexing was some work, but still small considering index's size.
Considering load one node is fairly enough to handle that, so why add
more? If it could be caused just by splitting shards and creating replicas
to have a 'healthy' cluster, why those nodes were added so late? This all
just doesn't add up.

Regards,
Peter.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/344f6e70-65cb-4ac6-af3d-ceb5baf09dc2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

The only time a new node will automatically join a cluster is if it has the
same cluster.name and you are using multicast discovery.
ES does not automatically create nodes for the cluster, there must be
something else happening on your end.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 19 May 2014 21:15, Piotr Jacewicz piotr.jacewicz.88@gmail.com wrote:

Hi,

Recently I have found out that on one of the servers my ES create
additional node few days after launch, then one more 2 days later. ES on
this host was alone node not connected to any cluster. I have already found
out that these are worker nodes and number of all nodes on this host is
exact equivalent of max number of nodes per host . They were created
exactly at midnight. From logs I see that it's right before performing
daily reindexing from DB (about 2000 docs, so tiny number).

I've got some questions related to that for which I couldn't google the
answer:

  1. What could cause these nodes to be created (and what usually is the
    cause - is there any documentation about that)? Was that reindexing init?
    (actual reindexing is logged after creating a node)
  2. Does number of nodes shrink under any circumstances?

I'm wondering ... that host was almost completely idle and only daily
reindexing was some work, but still small considering index's size.
Considering load one node is fairly enough to handle that, so why add
more? If it could be caused just by splitting shards and creating replicas
to have a 'healthy' cluster, why those nodes were added so late? This all
just doesn't add up.

Regards,
Peter.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/344f6e70-65cb-4ac6-af3d-ceb5baf09dc2%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/344f6e70-65cb-4ac6-af3d-ceb5baf09dc2%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624a%3Dhq5eozzSCR3N1OGkKEK1WBN6foWwudx3A1%2BSL2qJYg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3