Elasticsearch on EC2 R3 instances ==> trouble

Elastic Stack Elasticsearch
1

Hi,

Here is something worth sharing, I think. For Logsene
http://sematext.com/logsene/, We've been trying out EC2 R3 instances
(specifically r3.large) with Elasticsearch (1.1.x and 1.3.x including
1.3.2) with the latest Java 7 update 67. We tried this on Ubuntu 14.04
AMI, as well as Amazon Linux AMI.

In all cases we see Elasticsearch (or the JVM?) periodically "freezing" for
minutes at a time.

Here is a graph that shows
this: https://apps.sematext.com/spm-reports/s/kOn7sFUCe2 -- uncheck all
checkboxes except the one on the right -- "total opened HTTP conns
(total_opened)'" and you will see the pauses on 3-4 servers happening.

We'll move off of R3s, but wanted to share this in case anyone else runs
into the same problem. We don't have this problem on instances of other
types we are running.

Otis

Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/29747374-ad7e-4b94-9cf2-8a01fd75eb51%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

We are actively using the r3 series in EC2 and have not experienced any
issues. We are also using Java 7u67 but we are using Ubuntu 12.04
exclusively. We have tested with ES 1.1.1 and 1.3.2 and have not run into
any issues. We are predominantly using the r3.2xls but I think we have used
some r3.xls and r3.larges. Are you doing anything special with networking?
Drivers? EBS optimized?

Thanks,

Chris

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/23002828-850b-4636-8734-d1283821ccd8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

3

Otis, are you using CMS GC or G1GC?

On Thu, Sep 25, 2014 at 9:35 AM, Chris Rimondi chris.rimondi@gmail.com
wrote:

We are actively using the r3 series in EC2 and have not experienced any
issues. We are also using Java 7u67 but we are using Ubuntu 12.04
exclusively. We have tested with ES 1.1.1 and 1.3.2 and have not run into
any issues. We are predominantly using the r3.2xls but I think we have used
some r3.xls and r3.larges. Are you doing anything special with networking?
Drivers? EBS optimized?

Thanks,

Chris

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/23002828-850b-4636-8734-d1283821ccd8%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/23002828-850b-4636-8734-d1283821ccd8%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKe7ALdSkVBupOOoDFGCQjKuHbV7isg_VnBfpLxRmny9wo-8_w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

4

That is a good question. We noticed long GC pause times before we switched
over to G1GC.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b8fe2cca-efdb-42d5-8d1b-d55010c7c813%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.