ElasticSearch slow/crashing

Hi,

I've just setup an ElasticSearch index and it's performing very poorly.
There's no information in the guide about running ElasticSearch from an
operational perspective, which is a frustrating experience as a newcomer.
Is there anything like MongoDB's production noteshttp://docs.mongodb.org/manual/administration/production-notes/ available
anywhere on the web? Are there rules of thumb about how to configure
ElasticSearch or troubleshoot it? I installed the .deb package, inserted
50M records, and the default out-of-the-box performance is very bad. The
data I'm working with is professional resumes and I'm trying to do searches
for job candidates with the Java client library.

Thanks,
Ben

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

There is nothing official, but I have collected a few random blog posts
over the years:



http://exploringelasticsearch.com/
http://euphonious-intuition.com/2013/02/five-things-i-learned-from-elasticsearch-training/

Out-of-the-box, elasticsearch performs pretty well as far as default server
settings go. Set your JVM to use 50% of the available memory on the server.
Can you share your index mapping and an example query? Are you using facets
or nested/child objects? There are many ways to achieve poor performance
via inefficiencies in the mapping.

--
Ivan

On Wed, Aug 7, 2013 at 7:55 PM, Ben McCann benjamin.j.mccann@gmail.comwrote:

Hi,

I've just setup an ElasticSearch index and it's performing very poorly.
There's no information in the guide about running ElasticSearch from an
operational perspective, which is a frustrating experience as a newcomer.
Is there anything like MongoDB's production noteshttp://docs.mongodb.org/manual/administration/production-notes/ available
anywhere on the web? Are there rules of thumb about how to configure
ElasticSearch or troubleshoot it? I installed the .deb package, inserted
50M records, and the default out-of-the-box performance is very bad. The
data I'm working with is professional resumes and I'm trying to do searches
for job candidates with the Java client library.

Thanks,
Ben

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Ivan, thanks so much for sharing! Setting the heap size correctly made the
query 10x faster! I'll read the rest of the docs you sent and see if I can
squeeze out any other improvements, but as long as performance is
consistent at this level for the other queries I'll want to do, then I
should be good to go. I submitted a pull request to better document this
setting https://github.com/elasticsearch/elasticsearch/pull/3460 in the
start script, so that others have an easier time getting started.

Thanks again!
-Ben

On Wed, Aug 7, 2013 at 8:35 PM, Ivan Brusic ivan@brusic.com wrote:

There is nothing official, but I have collected a few random blog posts
over the years:
http://www.xmsxmx.com/elasticsearch-cluster-configuration-best-practices/
http://asquera.de/opensource/2012/11/25/elasticsearch-pre-flight-checklist/
http://exploringelasticsearch.com/

http://euphonious-intuition.com/2013/02/five-things-i-learned-from-elasticsearch-training/

http://www.slideshare.net/kucrafal/scaling-massive-elastic-search-clusters-rafa-ku-sematext

Out-of-the-box, elasticsearch performs pretty well as far as default
server settings go. Set your JVM to use 50% of the available memory on the
server. Can you share your index mapping and an example query? Are you
using facets or nested/child objects? There are many ways to achieve poor
performance via inefficiencies in the mapping.

--
Ivan

On Wed, Aug 7, 2013 at 7:55 PM, Ben McCann benjamin.j.mccann@gmail.comwrote:

Hi,

I've just setup an ElasticSearch index and it's performing very poorly.
There's no information in the guide about running ElasticSearch from an
operational perspective, which is a frustrating experience as a newcomer.
Is there anything like MongoDB's production noteshttp://docs.mongodb.org/manual/administration/production-notes/ available
anywhere on the web? Are there rules of thumb about how to configure
ElasticSearch or troubleshoot it? I installed the .deb package, inserted
50M records, and the default out-of-the-box performance is very bad. The
data I'm working with is professional resumes and I'm trying to do searches
for job candidates with the Java client library.

Thanks,
Ben

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/0Ynvtnrt0vg/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
about.me/benmccann

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.