Design question


(Mohit Anchlia) #1

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Alexander Reelsen) #2

Hey,

stability can be one of the reasons. As your data nodes can go out of
memory if you fire up certain queries, you do not want the cluster
stability impacted by this. A strategy to circumvent this problem is to
have a couple of data and master only nodes.

Hope this helps,

--Alex

On Fri, Nov 15, 2013 at 7:17 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Mohit Anchlia) #3

But if there are issues with data nodes that would impact the user requests
anyways, correct?

On Fri, Nov 15, 2013 at 10:39 AM, Alexander Reelsen alr@spinscale.dewrote:

Hey,

stability can be one of the reasons. As your data nodes can go out of
memory if you fire up certain queries, you do not want the cluster
stability impacted by this. A strategy to circumvent this problem is to
have a couple of data and master only nodes.

Hope this helps,

--Alex

On Fri, Nov 15, 2013 at 7:17 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Shuai Lin) #4

I guess you mean "data node" and "non data node"?

A shard of an index is replicated across the data nodes (you can config the
number of replicas). In case of some data node failure, your user would not
be impacted as long there is one replica available,

On Sat, Nov 16, 2013 at 2:50 AM, Mohit Anchlia mohitanchlia@gmail.comwrote:

But if there are issues with data nodes that would impact the user
requests anyways, correct?

On Fri, Nov 15, 2013 at 10:39 AM, Alexander Reelsen alr@spinscale.dewrote:

Hey,

stability can be one of the reasons. As your data nodes can go out of
memory if you fire up certain queries, you do not want the cluster
stability impacted by this. A strategy to circumvent this problem is to
have a couple of data and master only nodes.

Hope this helps,

--Alex

On Fri, Nov 15, 2013 at 7:17 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Justin-2) #5

Do you mean physically separated in the LAN or WAN/VPN or not running data
node service on a master?
On Nov 15, 2013 1:17 PM, "Mohit Anchlia" mohitanchlia@gmail.com wrote:

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Mohit Anchlia) #6

I mean not running master + data on the same node and keeping them separate.

On Fri, Nov 15, 2013 at 8:24 PM, Justin tcpandip@gmail.com wrote:

Do you mean physically separated in the LAN or WAN/VPN or not running data
node service on a master?
On Nov 15, 2013 1:17 PM, "Mohit Anchlia" mohitanchlia@gmail.com wrote:

Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Norberto Meijome) #7

We've found keeping them separate ( different servers /instances ) evens
out CPU usage ... The master node would get starved of CPU and drag down
the whole cluster performance ( and sometimes affected cluster health) .
not sure how would this work with multiple nodes with different settings on
the same box...
Is there any advantage of keeping Master Node separate from Data Node? I
can't think of a possible reason why one would want to keep them separate.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #8