Reliability of ElasticSearch

Elastic Stack Elasticsearch
1

I am new to ElasticSearch and asked to design ElasticSearch for log search.
One of the big requirement is availability > 99.9%. If you have designed
elastic search, could you please share your top 3 lessons that you learn to
make elastic search highly available?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAHsnNRh-qPc1Q1j%3DCxY6zh8e7UQ4j%2B8Oj5E4mir5TPC_1Ly0%3Dw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

2

Have an uneven number of master eligible nodes.
Set discovery.zen.minimum_master_nodes equal to
​ number masters​/2+1.
Ensure you have monitoring setup, both on ES and the OS.

There's lots more though, but that's a start.

On 2 December 2014 at 05:15, Xinli Shang xinlishang@gmail.com wrote:

I am new to Elasticsearch and asked to design Elasticsearch for log
search. One of the big requirement is availability > 99.9%. If you have
designed Elasticsearch, could you please share your top 3 lessons that you
learn to make Elasticsearch highly available?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAHsnNRh-qPc1Q1j%3DCxY6zh8e7UQ4j%2B8Oj5E4mir5TPC_1Ly0%3Dw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAHsnNRh-qPc1Q1j%3DCxY6zh8e7UQ4j%2B8Oj5E4mir5TPC_1Ly0%3Dw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZk201qXxXbp-oJTp%2BSPrK0JTVCPbVQDKnEBFk9ny%3D42DA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

99.9% uptime allows almost nine hours a year. You could totally manage
that if you have someone on call 24/7. Elasticsearch itself is reasonably
stable especially if you don't expose very complex queries to everyone. We
do and we only have one person on call (me) and we've probably just made
that 99.9% uptime this year. I imagine next year it'll be better because
we'll have a whole year of experience with it in production.

Nik

On Mon, Dec 1, 2014 at 5:54 PM, Mark Walkom markwalkom@gmail.com wrote:

Have an uneven number of master eligible nodes.
Set discovery.zen.minimum_master_nodes equal to
​ number masters​/2+1.
Ensure you have monitoring setup, both on ES and the OS.

There's lots more though, but that's a start.

On 2 December 2014 at 05:15, Xinli Shang xinlishang@gmail.com wrote:

I am new to Elasticsearch and asked to design Elasticsearch for log
search. One of the big requirement is availability > 99.9%. If you have
designed Elasticsearch, could you please share your top 3 lessons that you
learn to make Elasticsearch highly available?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAHsnNRh-qPc1Q1j%3DCxY6zh8e7UQ4j%2B8Oj5E4mir5TPC_1Ly0%3Dw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAHsnNRh-qPc1Q1j%3DCxY6zh8e7UQ4j%2B8Oj5E4mir5TPC_1Ly0%3Dw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZk201qXxXbp-oJTp%2BSPrK0JTVCPbVQDKnEBFk9ny%3D42DA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZk201qXxXbp-oJTp%2BSPrK0JTVCPbVQDKnEBFk9ny%3D42DA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd16UPemVx9tXKDC0m-Wu8Y3o_RGN9YPpX16frYYx9BLzw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.