Scrolling and lucene segments

Elastic Stack Elasticsearch
1

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-scroll.html

Normally, the background merge process optimizes the index by merging
together smaller segments to create new bigger segments, at which time the
smaller segments are deleted. This process continues during scrolling, but
an open search context prevents the old segments from being deleted while
they are still in use. This is how Elasticsearch is able to return the
results of the initial search request, regardless of subsequent changes to
documents.

Tip
Keeping older segments alive means that more file handles are needed.
Ensure that you have configured your nodes to have ample free file handles.
See the section called “File Descriptorsedit”.

Hello,

Read the above description, can anyone tell what happened to the segments
after the scroll time expired? Does the segments will automatically merge?
What if a lot (like 50 active) of scroll happened and how will it impact
the lucene segment/elasticsearch? comments?

Jason

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2971e92d-397f-4d4b-a6da-0428a6cde638%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

The segments are effectively ref counted, so once the last scroll still
using an old (already merged away) segment is deleted, it will be removed.

Mike McCandless

http://blog.mikemccandless.com

On Fri, Jan 16, 2015 at 4:15 AM, Jason Wee peichieh@gmail.com wrote:

Elasticsearch Platform — Find real-time answers at scale | Elastic

Normally, the background merge process optimizes the index by merging
together smaller segments to create new bigger segments, at which time the
smaller segments are deleted. This process continues during scrolling, but
an open search context prevents the old segments from being deleted while
they are still in use. This is how Elasticsearch is able to return the
results of the initial search request, regardless of subsequent changes to
documents.

Tip
Keeping older segments alive means that more file handles are needed.
Ensure that you have configured your nodes to have ample free file handles.
See the section called “File Descriptorsedit”.

Hello,

Read the above description, can anyone tell what happened to the segments
after the scroll time expired? Does the segments will automatically merge?
What if a lot (like 50 active) of scroll happened and how will it impact
the lucene segment/elasticsearch? comments?

Jason

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2971e92d-397f-4d4b-a6da-0428a6cde638%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2971e92d-397f-4d4b-a6da-0428a6cde638%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAD7smRfPHTg6K7A9jn%3D3nT26hjmCBUkydzFZzyJNn8pxv8g%3DdA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.