Only send requests directly to data notes and not master nodes?

Justin_Zhu_2 · January 17, 2015, 9:23pm

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly instead?

Thanks.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · January 18, 2015, 2:54am

Depends, sounds like you need a few client nodes if you are OOMing your
masters (which, is a bad thing to happen to masters).

On 18 January 2015 at 10:23, Justin Zhu haoranjzhu@gmail.com wrote:

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly instead?

Thanks.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8jY6gq8qJuNgpr01A%3DTc8pryy7ML82dvxUJWBw26P0wg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Justin_Zhu_2 · January 19, 2015, 3:48am

We give the master nodes 5gb of memory -- stats are showing low cpu &
memory utilization. Would you still recommend the client only node? If so,
how many & powerful?

On Saturday, January 17, 2015 at 6:55:12 PM UTC-8, Mark Walkom wrote:

Depends, sounds like you need a few client nodes if you are OOMing your
masters (which, is a bad thing to happen to masters).

On 18 January 2015 at 10:23, Justin Zhu <haora...@gmail.com <javascript:>>
wrote:

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly instead?

Thanks.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · January 19, 2015, 4:42am

It depends on your use, but try adding one client in with 8GB heap and see
how you go.

On 19 January 2015 at 16:48, Justin Zhu haoranjzhu@gmail.com wrote:

We give the master nodes 5gb of memory -- stats are showing low cpu &
memory utilization. Would you still recommend the client only node? If so,
how many & powerful?

On Saturday, January 17, 2015 at 6:55:12 PM UTC-8, Mark Walkom wrote:

Depends, sounds like you need a few client nodes if you are OOMing your
masters (which, is a bad thing to happen to masters).

On 18 January 2015 at 10:23, Justin Zhu haora...@gmail.com wrote:

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly
instead?

Thanks.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9sRKQLksSM2bxyOaY2CG%3D7JeUt6ZDOorFLhn1YwhJ7BQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Justin_Zhu_2 · January 19, 2015, 6:48am

Would all transport clients only connect to this client node? Right now we
have them connecting to all 3 master node.

On Sunday, January 18, 2015 at 8:43:08 PM UTC-8, Mark Walkom wrote:

It depends on your use, but try adding one client in with 8GB heap and see
how you go.

On 19 January 2015 at 16:48, Justin Zhu <haora...@gmail.com <javascript:>>
wrote:

We give the master nodes 5gb of memory -- stats are showing low cpu &
memory utilization. Would you still recommend the client only node? If so,
how many & powerful?

On Saturday, January 17, 2015 at 6:55:12 PM UTC-8, Mark Walkom wrote:

Depends, sounds like you need a few client nodes if you are OOMing your
masters (which, is a bad thing to happen to masters).

On 18 January 2015 at 10:23, Justin Zhu haora...@gmail.com wrote:

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly
instead?

Thanks.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/08805992-9794-4465-b900-d067bcbed3a3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · January 19, 2015, 11:57am

Again, it's up to you. I'd suggest yes and let the masters manage the
cluster. You may need more client nodes though.

On 19 January 2015 at 19:48, Justin Zhu haoranjzhu@gmail.com wrote:

Would all transport clients only connect to this client node? Right now we
have them connecting to all 3 master node.

On Sunday, January 18, 2015 at 8:43:08 PM UTC-8, Mark Walkom wrote:

It depends on your use, but try adding one client in with 8GB heap and
see how you go.

On 19 January 2015 at 16:48, Justin Zhu haora...@gmail.com wrote:

We give the master nodes 5gb of memory -- stats are showing low cpu &
memory utilization. Would you still recommend the client only node? If so,
how many & powerful?

On Saturday, January 17, 2015 at 6:55:12 PM UTC-8, Mark Walkom wrote:

Depends, sounds like you need a few client nodes if you are OOMing your
masters (which, is a bad thing to happen to masters).

On 18 January 2015 at 10:23, Justin Zhu haora...@gmail.com wrote:

We have a 9 node cluster, 3 masters, 6 data. We've been using the java
transport client, which connects to all 3 masters. Occassionaly the masters
become unresponsive and needs to restart.

Should the transport clients connect to the 6 data nodes directly
instead?

Thanks.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40goo
glegroups.com
https://groups.google.com/d/msgid/elasticsearch/752c15cc-bf88-4219-8699-279466534696%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/6d55f417-6584-46b4-83e5-daf1267e771e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/08805992-9794-4465-b900-d067bcbed3a3%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/08805992-9794-4465-b900-d067bcbed3a3%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8wht-8HQ3t5B%3D5E9X5nXBRw%3D_318czUy0PZ_a__ZKq8g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.