Set the number of index segments for indexing


(Ophir Michaeli) #1

Hi,

While optimizing it's pretty easy to determine the number of segments by
executing Optimize command with max_num_segments parameter.
My question is about indexing prior to optimizing.
I checked the
http://www.elasticsearch.org/guide/en/elasticsearch/reference/0.90/index-modules-merge.html#tiered section
and I still couldn't find - how do I control the number of segments during
indexing? Is there a simple way to tell to ES that I am willing to pay with
indexing time and frequent merges but keep number of segments below 10, for
example?

Thanks,
Ophir

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3a57e027-1cd3-4578-9421-bf351e833dd4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Jörg Prante) #2

It's a bit more complex. You can use the "segments_per_tier" to limit the
number of segments to be created at a tier. Together with
"max_merge_at_once" you can control the amount of running merges.

Mike McCandless is the authority who can explain how the tiered merge
policy works:

Jörg

On Thu, Jul 3, 2014 at 4:04 PM, Ophir Michaeli ophirmichaeli@gmail.com
wrote:

Hi,

While optimizing it's pretty easy to determine the number of segments by
executing Optimize command with max_num_segments parameter.
My question is about indexing prior to optimizing.
I checked the
http://www.elasticsearch.org/guide/en/elasticsearch/reference/0.90/index-modules-merge.html#tiered section
and I still couldn't find - how do I control the number of segments during
indexing? Is there a simple way to tell to ES that I am willing to pay with
indexing time and frequent merges but keep number of segments below 10, for
example?

Thanks,
Ophir

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3a57e027-1cd3-4578-9421-bf351e833dd4%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3a57e027-1cd3-4578-9421-bf351e833dd4%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHqa7%2BBwppDPdgUoOmKjoDu9eByWHLb850R%2Bi3GF4NLTQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3