Usage of Elastic Search in Production Environment

We just went into production this week with 0.17.0 on Amazon EC2.

Two large instances running tomcat for with an Amazon elastic load
balancer out in front.
Two large instances that run Mongo (using replicasets) and
Elasticsearch. We are using the default settings for shards/replicas
at the moment for elasticsearch.
We have a micro AMI with only elasticsearch on it so that we can bring
up/take down one or more elasticsearch nodes at any given time.
At this point we are only in the thousands as far as documents go, but
our application records every request that a user makes so that will
quickly grow.
All I can say about performance is that it's been fast and it's been
reliable. We had an issue with the trans log and too many open files
(we had our limit set at 32k) the other day after we imported 10
thousand users without using a bulk request in our Grails application.
0.17.3 should fix the trans log issues.

Elasticsearch is amazing. It was so easy to set up and scale out. I
think that MongoDB and Elasticsearch make a great couple in an
environment like EC2 :wink:

On Aug 4, 2:13 am, Eran Kutner e...@gigya-inc.com wrote:

Can you (and other other people who responded) say something about your
setup? Will be very interesting to know what configuration you're using to
support this index.
I'm particularly interested in:

  • How many servers, and roughly what's their hardware configuration?
  • How many shards?
  • How many replicas?
  • Are they all on the same index?
  • How many documents per index?
  • What kind of performance are you getting?
  • Anything else interesting :slight_smile:

Thanks.