After digging more into the new CCR functionality and its capability of storing a history of events for possible folllowers I started to get curious on how high I could set the soft_delete setting on an index.
For my understanding, soft_deletes are gone after a merge happened. A merge, can occur quite quickly if there is more load on an index, which results in data loss (happened multiple times to me while testing).
Coming to my question, is there a rule of thumb for calculating a reasonable retention rate? And is there a way to prevent an index from merging too early?
Thanks in advance!