Is es really load balance?


(天行) #1

When i restart the nodes, i find all primary shards go to the node1, and
all replica shards go to the node0.
So, when i bulk write to the es, i find the node1 has more LOAD then the
node0.
I want to ask whether some thing i must set to avoid all shards go to one
node?

The follow is the monitor for the two node when i bulk write to es:
https://lh3.googleusercontent.com/-sXUtxqGpQng/U88OPdOy6FI/AAAAAAAAAmU/HjvZahKTdoE/s1600/es1.jpg
https://lh6.googleusercontent.com/-i43TeIgmDDk/U88Op7qr-qI/AAAAAAAAAmc/fZQx-G_n-Jk/s1600/es2.jpg
https://lh3.googleusercontent.com/-HxyBmw2CEHU/U88O7234MxI/AAAAAAAAAmk/waP5Q59QF44/s1600/es3.jpg

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1966abc6-1668-4438-a7b2-b127d2b20794%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Pablo Musa) #2

must set to avoid all shards go to one node?

Did you mean primary shards?

The difference between primary shards and replicas is very small (almost a
flag).

node1 has more LOAD then the node0

What do you by load?
If you are talking about OS load, you are probably doing the bulk request
to node1
and he is sending information to node0. So yes, node1 has more load than
node0.
If you make the bulk request to node0, you will see (I trully hope it) that
you get
the opposite LOAD.

Notice that it does not depend on the primary or replica thing.

Regards,
Pablo

On Tuesday, July 22, 2014 10:25:59 PM UTC-3, 天行 wrote:

When i restart the nodes, i find all primary shards go to the node1, and
all replica shards go to the node0.
So, when i bulk write to the es, i find the node1 has more LOAD then the
node0.
I want to ask whether some thing i must set to avoid all shards go to one
node?

The follow is the monitor for the two node when i bulk write to es:

https://lh3.googleusercontent.com/-sXUtxqGpQng/U88OPdOy6FI/AAAAAAAAAmU/HjvZahKTdoE/s1600/es1.jpg

https://lh6.googleusercontent.com/-i43TeIgmDDk/U88Op7qr-qI/AAAAAAAAAmc/fZQx-G_n-Jk/s1600/es2.jpg

https://lh3.googleusercontent.com/-HxyBmw2CEHU/U88O7234MxI/AAAAAAAAAmk/waP5Q59QF44/s1600/es3.jpg

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a0ba135f-8a75-48d3-9497-8417ea668936%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(天行) #3

Yes, i mean primary shards. And i use 10 threads for bulk request to the es.There are 5 threads get connet to the node0, and another 5 threads connet to the node1.
So, i guess if the bulk write first going to the primary shards, and when there are enough data , then write to the replica shards(that means some times write to primary shard, one time write to replica shard)?

diguo58@gmail.com

From: pablitomusa
Date: 2014-07-23 13:20
To: elasticsearch
Subject: Re: Is es really load balance?

must set to avoid all shards go to one node?

Did you mean primary shards?

The difference between primary shards and replicas is very small (almost a flag).

node1 has more LOAD then the node0

What do you by load?
If you are talking about OS load, you are probably doing the bulk request to node1
and he is sending information to node0. So yes, node1 has more load than node0.
If you make the bulk request to node0, you will see (I trully hope it) that you get
the opposite LOAD.

Notice that it does not depend on the primary or replica thing.

Regards,
Pablo

On Tuesday, July 22, 2014 10:25:59 PM UTC-3, 天行 wrote:
When i restart the nodes, i find all primary shards go to the node1, and all replica shards go to the node0.
So, when i bulk write to the es, i find the node1 has more LOAD then the node0.
I want to ask whether some thing i must set to avoid all shards go to one node?

The follow is the monitor for the two node when i bulk write to es:

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/O9BIk2Qh_iw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a0ba135f-8a75-48d3-9497-8417ea668936%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2014072914531867450914%40gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #4