Index paramerters


(benjelloun) #1

Hello,

I need to index 100 000 documents with 1Mo.
This is my configuration of ElasticSearch index:

"index": {

"type": "doc",

"bulk_size": 100,

"number_of_shards" : 5, 

"number_of_replicas" : 2

}

I need to know what each parameters effect.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bdf82941-c406-4f91-94cd-adddf35676ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(benjelloun) #2

Hello,

I found some informations wich are not complete :

There is no “correct” number of actions to perform in a single bulk call.
You should experiment with different settings to find the optimum size for
your particular workload.

Every time you index a document elasticsearch will decide which primary
shard is supposed to hold that document and will index it there. Primary
shards are not copy of the data, they are the data! Having multiple shards
does help taking advantage of parallel processing on a single machine

Another type of shard is replica. The default is 1, meaning that every
primary shard will be copied to another shard that will contain the same
data. Replicas are used to increase search performance and for fail-over.

regards,

Anass BENJELLOUN

Le jeudi 22 mai 2014 09:26:35 UTC+2, anass benjelloun a écrit :

Hello,

I need to index 100 000 documents with 1Mo.
This is my configuration of ElasticSearch index:

"index": {

"type": "doc",

"bulk_size": 100,

"number_of_shards" : 5, 

"number_of_replicas" : 2

}

I need to know what each parameters effect.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/570e793b-4f7a-4021-a8a4-5453d59a154c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3