"Idle" node traffic


(Glen Smith) #1

In a cluster where there is no client activity happening (no index or
search requests), how much data, roughly, is being sent between the nodes?
I was able to find a nice blog post from Njal Karevoll at found.no that
explained all the transport channels per node, but nothing about the
steady-state volume of data.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/caf2799b-82d2-4a28-8671-60f0e9f96137%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Nik Everett) #2

This node is empty but running in a cluster serving traffic:
http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&h=elastic1017.eqiad.wmnet&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2
Here is the rest of the cluster:
http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2

Its not exactly what you asked for, but its something. I imagine the
activity on empty nodes when there is no traffic would be lower but I'm not
sure by how much.

Nik

On Fri, Jul 18, 2014 at 10:01 AM, Glen Smith glen@smithsrock.com wrote:

In a cluster where there is no client activity happening (no index or
search requests), how much data, roughly, is being sent between the nodes?
I was able to find a nice blog post from Njal Karevoll at found.no that
explained all the transport channels per node, but nothing about the
steady-state volume of data.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/caf2799b-82d2-4a28-8671-60f0e9f96137%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/caf2799b-82d2-4a28-8671-60f0e9f96137%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0cP8Qx8UbupfLtmMfEZaUgUGC0-%2B35XB3W6cLLW9RiGg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Glen Smith) #3

Thank you very much for the links!

I'm trying to infer what I can from them (looks like there are 19 nodes in
the cluster, and this single cluster is averaging about 165kBytes/sec sent
over the last hour.

I'm still hoping there will be a more formal answer detailing the
node-to-node communications, how it might geometrically increase with the
number of nodes (since, AFAICT, each node pair is directly connected),
whether it changes based on the number of indices or shards, etc.

On Friday, July 18, 2014 10:36:25 AM UTC-4, Nikolas Everett wrote:

This node is empty but running in a cluster serving traffic:

http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&h=elastic1017.eqiad.wmnet&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2
Here is the rest of the cluster:

http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2

Its not exactly what you asked for, but its something. I imagine the
activity on empty nodes when there is no traffic would be lower but I'm not
sure by how much.

Nik

On Fri, Jul 18, 2014 at 10:01 AM, Glen Smith <gl...@smithsrock.com
<javascript:>> wrote:

In a cluster where there is no client activity happening (no index or
search requests), how much data, roughly, is being sent between the nodes?
I was able to find a nice blog post from Njal Karevoll at found.no that
explained all the transport channels per node, but nothing about the
steady-state volume of data.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/caf2799b-82d2-4a28-8671-60f0e9f96137%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/caf2799b-82d2-4a28-8671-60f0e9f96137%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/20fb79c0-75f5-418a-ab47-3cc7236fc10d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #4