Just wanted to post how ecstatic I am with search performance.
My h/w is 24 CPU cores w/ 48GB or ram. I have 45 indexes total with
the largest getting a couple of shards, for a total of 75 shards. I
have 20 million documents with an index size of ~28GB.
I am able to pump through ~450 real world queries per second. The
queries are very large boolean queries, some with wildcards and prefix
queries and represent 10+ years of legacy queries that are far from
optimal in most cases. These are not the standard simple test queries.
Also, these are queries that have made it past our caching layer,
implying that there is a lot of variation in the requests.
The obvious bottleneck ends up being CPU saturation. Disk load looks
If I start a flood of documents indexing, things slow down a little,
but not much.
ES consumes ~10GB of JVM heap in this setup.
I'm assuming that the system is using the rest of the RAM for disk
Thanks for the great work!