'NoNodeAvailable' exception JMeter 10K requests

Elastic Stack Elasticsearch
1

Hi All,

I am trying to do some es perf analysis. I have an AWS machine [quad core +
16 gigs]. I have started the ES with 8 gigs. version 1.21

The ES server is a single cluster multi node setup. There are 9 nodes as of
now.
5M nodes - There are 3 nodes having 5M records each with 1/2/4 shard config.
10M nodes - There are 3 nodes having 10M records each with 1/2/4 shard
config.
20M nodes - There are 3 nodes having 20M records each with 1/2/4 shard
config.

Now i have written a java class extending 'AbstractJavaSamplerClient' [a
Jmeter Custom java sampler]which creates some search requests.
Thing is that it works fine for almost 2500 requests but anything more than
that, it starts throwing the 'NoNodeAvailable' exception.

This is a jmeter test case that i am running in the non-gui mode. I have
not used any heavy graphical listeners. I am using 'Aggregate Report'
listener. But for debugging i have added 'View Results Tree' listener as
well so that i know what happened to each request. This happens in both the
cases [the failure after 2500 requests] if i use or don't use the VRT
listener.

This is the ex stack-trace
Response message: Exception: No node available
at
org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:219)
at
org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106)
at
org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:212)
at
org.elasticsearch.client.transport.TransportClient.search(TransportClient.java:420)
at
org.elasticsearch.action.search.SearchRequestBuilder.doExecute(SearchRequestBuilder.java:1071)
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:85)
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:59)
at
com.readypulse.utils.ElasticSearchSamplerClient.runTest(ElasticSearchSamplerClient.java:59)
at
org.apache.jmeter.protocol.java.sampler.JavaSampler.sample(JavaSampler.java:191)
at
org.apache.jmeter.threads.JMeterThread.process_sampler(JMeterThread.java:429)
at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:257)
at java.lang.Thread.run(Thread.java:745)

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/574a3474-d5c3-4d21-8a9e-5abb674f5264%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Nodes did not respond, and if the last node disconnected and does not
respond, the TransportClient reports in his log "no node available".

You have to look in the logs of the cluster nodes, there is more
information.

Jörg

On Mon, Sep 15, 2014 at 3:51 PM, Vidosh Sahu vidosh@readypulse.com wrote:

Hi All,

I am trying to do some es perf analysis. I have an AWS machine [quad core

  • 16 gigs]. I have started the ES with 8 gigs. version 1.21

The ES server is a single cluster multi node setup. There are 9 nodes as
of now.
5M nodes - There are 3 nodes having 5M records each with 1/2/4 shard
config.
10M nodes - There are 3 nodes having 10M records each with 1/2/4 shard
config.
20M nodes - There are 3 nodes having 20M records each with 1/2/4 shard
config.

Now i have written a java class extending 'AbstractJavaSamplerClient' [a
Jmeter Custom java sampler]which creates some search requests.
Thing is that it works fine for almost 2500 requests but anything more
than that, it starts throwing the 'NoNodeAvailable' exception.

This is a jmeter test case that i am running in the non-gui mode. I have
not used any heavy graphical listeners. I am using 'Aggregate Report'
listener. But for debugging i have added 'View Results Tree' listener as
well so that i know what happened to each request. This happens in both the
cases [the failure after 2500 requests] if i use or don't use the VRT
listener.

This is the ex stack-trace
Response message: Exception: No node available
at
org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:219)
at
org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106)
at
org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:212)
at
org.elasticsearch.client.transport.TransportClient.search(TransportClient.java:420)
at
org.elasticsearch.action.search.SearchRequestBuilder.doExecute(SearchRequestBuilder.java:1071)
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:85)
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:59)
at
com.readypulse.utils.ElasticSearchSamplerClient.runTest(ElasticSearchSamplerClient.java:59)
at
org.apache.jmeter.protocol.java.sampler.JavaSampler.sample(JavaSampler.java:191)
at
org.apache.jmeter.threads.JMeterThread.process_sampler(JMeterThread.java:429)
at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:257)
at java.lang.Thread.run(Thread.java:745)

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/574a3474-d5c3-4d21-8a9e-5abb674f5264%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/574a3474-d5c3-4d21-8a9e-5abb674f5264%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEcH_pnggU%3DXd_aMgskQeT0DnBxfHPV92g9%2B21jcoT4jw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.