Is external Load Balance useful?


(Xudong You) #1

Hi,
I am building Elasticsearch on Microsoft Azure Virtual machines. With Azure
VM, I could build Load Balance on top of all my VMs so that I can wrap all
VMs into one single endpoint exposed for query.
Now my question is, is such external load balance really useful for query
or index performance? Since for each query, any node who receive the
request will forward the query request to all shards which loaded on other
VMs, so seems I can simply always send request to one node VM.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

It'd help if you had client nodes.
But it also helps if you don't, even though ES does connect to the nodes
with the shards it needs, distributing the initial query load across
multiple nodes means that you don't have a single node that has to deal
with all the indexing and querying results from the end users/clients.

On 29 April 2015 at 17:12, Xudong You xudong.you@gmail.com wrote:

Hi,
I am building Elasticsearch on Microsoft Azure Virtual machines. With
Azure VM, I could build Load Balance on top of all my VMs so that I can
wrap all VMs into one single endpoint exposed for query.
Now my question is, is such external load balance really useful for query
or index performance? Since for each query, any node who receive the
request will forward the query request to all shards which loaded on other
VMs, so seems I can simply always send request to one node VM.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-cg8v_CRwbscxavg-N6ko%3D_MxgLbQp7S4Fqf5nKED4ww%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Xudong You) #3

thanks your reply.
what do you mean by "client nodes"? Do you mean the "NO master and No data”
nodes just work as load balancer?

On Wednesday, April 29, 2015 at 3:27:42 PM UTC+8, Mark Walkom wrote:

It'd help if you had client nodes.
But it also helps if you don't, even though ES does connect to the nodes
with the shards it needs, distributing the initial query load across
multiple nodes means that you don't have a single node that has to deal
with all the indexing and querying results from the end users/clients.

On 29 April 2015 at 17:12, Xudong You <xudon...@gmail.com <javascript:>>
wrote:

Hi,
I am building Elasticsearch on Microsoft Azure Virtual machines. With
Azure VM, I could build Load Balance on top of all my VMs so that I can
wrap all VMs into one single endpoint exposed for query.
Now my question is, is such external load balance really useful for query
or index performance? Since for each query, any node who receive the
request will forward the query request to all shards which loaded on other
VMs, so seems I can simply always send request to one node VM.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8eab439a-46df-4601-92aa-5f0b0b053010%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #4

That is correct.
You can then put a load balancer in front of them.

On 29 April 2015 at 19:06, Xudong You xudong.you@gmail.com wrote:

thanks your reply.
what do you mean by "client nodes"? Do you mean the "NO master and No
data” nodes just work as load balancer?

On Wednesday, April 29, 2015 at 3:27:42 PM UTC+8, Mark Walkom wrote:

It'd help if you had client nodes.
But it also helps if you don't, even though ES does connect to the nodes
with the shards it needs, distributing the initial query load across
multiple nodes means that you don't have a single node that has to deal
with all the indexing and querying results from the end users/clients.

On 29 April 2015 at 17:12, Xudong You xudon...@gmail.com wrote:

Hi,
I am building Elasticsearch on Microsoft Azure Virtual machines. With
Azure VM, I could build Load Balance on top of all my VMs so that I can
wrap all VMs into one single endpoint exposed for query.
Now my question is, is such external load balance really useful for
query or index performance? Since for each query, any node who receive the
request will forward the query request to all shards which loaded on other
VMs, so seems I can simply always send request to one node VM.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3f330be7-1558-4158-9728-19655d7e790c%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8eab439a-46df-4601-92aa-5f0b0b053010%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/8eab439a-46df-4601-92aa-5f0b0b053010%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9kNhF%3DwUhrAEco8A%3DD3_UOMpPnVDVggkPkciBxN_SY6Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) closed #5