I have a question about implementing update and snapshot for indices with timestamp.
The index format looks like result-2018.07 result-2018-08 which is good to use curator to do snapshot and delete. However, the documents in each indices need to be updated very frequently, say one update per minute. Since update API does not allow wildcard index, and the sender does not know exactly which index to update, what is the best design in this case?
I have googled a little bit and there are two options:
- just use single index, which makes the the operation very heavy.
- update has an option, create if not exists.
But I am also worry about them:
for option 1: if snapshot is taking the difference, and one document had been updated between two snapshots. If I restore these two snapshots, will the document appear twice?
for option 2: there could be a case that the same ID shows up in multiple indices, if I do search by id in all indices, would it give me all documents with that ID?