Optimization not working

Elastic Stack Elasticsearch
1

Hi all
i have an index of around 10 gb , with 5 shards , and 0 replicas.
i submit an optimize command through rest with max_number_segments =5 ,
while using default merge policy. Although it returns with a proper
response on the browser , i do not see any activity happening in the
background, no io waits increasing , no cpu cycle increase in utilization .
The index is distributed on 5 nodes , along with other indexes , with each
shard on separate machine/node , with being allocated 8 Gb heap size each.

Could somebody please help me figure out how/why this is happening and how
could i resolve it ?

Thanks
Tarang Dawer

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

can you check how many segments you actually have via the segments API?

simon

On Wednesday, April 10, 2013 4:29:57 PM UTC+2, tarang dawer wrote:

Hi all
i have an index of around 10 gb , with 5 shards , and 0 replicas.
i submit an optimize command through rest with max_number_segments =5 ,
while using default merge policy. Although it returns with a proper
response on the browser , i do not see any activity happening in the
background, no io waits increasing , no cpu cycle increase in utilization .
The index is distributed on 5 nodes , along with other indexes , with each
shard on separate machine/node , with being allocated 8 Gb heap size each.

Could somebody please help me figure out how/why this is happening and how
could i resolve it ?

Thanks
Tarang Dawer

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

i checked , i still have 18 segments for the index , each consisting of
varying size, 90 , 51 , 65 42 mb's etc, for each shard . Despite the
optimize command , the segments structure remains the same. is there
something else required to be done to "force" merging / optimization ?

On Wed, Apr 10, 2013 at 8:16 PM, simonw
simon.willnauer@elasticsearch.comwrote:

can you check how many segments you actually have via the segments API?

Elasticsearch Platform — Find real-time answers at scale | Elastic

simon

On Wednesday, April 10, 2013 4:29:57 PM UTC+2, tarang dawer wrote:

Hi all
i have an index of around 10 gb , with 5 shards , and 0 replicas.
i submit an optimize command through rest with max_number_segments =5 ,
while using default merge policy. Although it returns with a proper
response on the browser , i do not see any activity happening in the
background, no io waits increasing , no cpu cycle increase in utilization .
The index is distributed on 5 nodes , along with other indexes , with
each shard on separate machine/node , with being allocated 8 Gb heap size
each.

Could somebody please help me figure out how/why this is happening and
how could i resolve it ?

Thanks
Tarang Dawer

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

4

That math is right. You will have max 5 segments per shard. You can force
down to 5 segments total, 1 per shard by setting max_number_segments=1.

Best Regards,
Paul

On Wednesday, April 10, 2013 9:30:53 AM UTC-6, tarang dawer wrote:

i checked , i still have 18 segments for the index , each consisting of
varying size, 90 , 51 , 65 42 mb's etc, for each shard . Despite the
optimize command , the segments structure remains the same. is there
something else required to be done to "force" merging / optimization ?

On Wed, Apr 10, 2013 at 8:16 PM, simonw <simon.w...@elasticsearch.com<javascript:>

wrote:

can you check how many segments you actually have via the segments API?

Elasticsearch Platform — Find real-time answers at scale | Elastic

simon

On Wednesday, April 10, 2013 4:29:57 PM UTC+2, tarang dawer wrote:

Hi all
i have an index of around 10 gb , with 5 shards , and 0 replicas.
i submit an optimize command through rest with max_number_segments =5 ,
while using default merge policy. Although it returns with a proper
response on the browser , i do not see any activity happening in the
background, no io waits increasing , no cpu cycle increase in utilization .
The index is distributed on 5 nodes , along with other indexes , with
each shard on separate machine/node , with being allocated 8 Gb heap size
each.

Could somebody please help me figure out how/why this is happening and
how could i resolve it ?

Thanks
Tarang Dawer

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.