TTL and Recovery


(Jan-Hendrik Lendholt) #1

Hi there,

just a short question:

When I have an index with documnets and the _ttl set, and ES has been shut
down, and gets started again, the documents that have expired in the
meantime gets purged.

Where exactly in the source code happens this? I was searching for ages but
all I could find was the IndicesTTLService.java file but that one does not
seem to be the right place.
I suppose it happens somewhere in the recovery process.

I tried to figure out by setting log level to trace but that did not give
me the right place either.

As always, any help is appreciated.

Thanks,

Jan

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Martijn Van Groningen) #2

Once a node starts, the IndicesTTLService is also started. The
IndicesTTLService
starts the PurgerThread thread that periodically deletes all expired
document for all indices that have a ttl configured. The deleting is
actually performed in the PurgerThread#purgeShards method.

If you set the 'indices.ttl' to 'DEBUG' in the logging.yml, you should see
the related log lines.

On 18 September 2013 12:39, Jan-Hendrik Lendholt jan.lendholt@gmail.comwrote:

Hi there,

just a short question:

When I have an index with documnets and the _ttl set, and ES has been shut
down, and gets started again, the documents that have expired in the
meantime gets purged.

Where exactly in the source code happens this? I was searching for ages
but all I could find was the IndicesTTLService.java file but that one
does not seem to be the right place.
I suppose it happens somewhere in the recovery process.

I tried to figure out by setting log level to trace but that did not give
me the right place either.

As always, any help is appreciated.

Thanks,

Jan

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Met vriendelijke groet,

Martijn van Groningen

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #3