Limits on number of documents


(wvsant) #1

We have been benchmarking solr with a total document volume of up to 200
million messages, with acceptable performance.
Still aiming higher, up to 4 billion, and expecting ES may offer better
scalability in terms of documents volume.
Does anyone have experience with high volumes ?
Any numbers mentioned would be helpfull.
Points of attention too.


(Clinton Gormley) #2

On Wed, 2012-08-08 at 08:12 -0700, wvsant wrote:

We have been benchmarking solr with a total document volume of up to
200 million messages, with acceptable performance.

Still aiming higher, up to 4 billion, and expecting ES may offer
better scalability in terms of documents volume.
Does anyone have experience with high volumes ?
Any numbers mentioned would be helpfull.
Points of attention too.

You may want to take a look at this video
http://www.elasticsearch.org/videos/2012/06/05/querying-24-billion-records-in-900ms.html


(system) #3