Sub-Indexes and Locking


(davrob) #1

Hi Shay,

In compass I could index my sub-indexes in parallel because locking
was on each sub-index separately. This greatly increased my indexing
speed. Is it possible to do the same thing in ElasticSearch? Can you
explain the locking mechanism in ElasticSearch or point me to the
relevant docs.

thanks,

David


(Shay Banon) #2

ElasticSearch works a bit differently, and in similar manner to the bulk update processor in last Compass version. It has a single locked index through the lifecycle of a shard, and index operations are done on it concurrently.
On Tuesday, January 18, 2011 at 12:30 PM, dalesrob wrote:

Hi Shay,

In compass I could index my sub-indexes in parallel because locking
was on each sub-index separately. This greatly increased my indexing
speed. Is it possible to do the same thing in ElasticSearch? Can you
explain the locking mechanism in ElasticSearch or point me to the
relevant docs.

thanks,

David


(system) #3