Is there any way of being notified about this or any way to find out?
What do you mean by "unIndexed?" This term is not one I'm familiar with.
Assume Curator is configured to delete, on a daily basis, documents that are over 30 days old. They get marked as such and once segments are merged, the documents are gone. No longer indexed. Unindexed (I will coin this term).
Curator can only delete entire indices. If you need to delete documents from within an index, you should look into delete_by_query
Yes I understand that, but surely the associated documents also get deleted right?
Think of it like SQL. A document is a row, and an index a table. Drop the table, and all the rows go with it. They don't get "tagged" for deletion. There's not even a need for a segment merge. An index deletion in Elasticsearch is quick and permanent. The segment files are purged from the filesystem immediately, unless you have a very slow cluster/node, in which case it will do it as soon as it can.
Ok I got you. Thanks
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.