Hi, this question is a follow on from a Previous post.
I am looking to merge many indices into 1 and using ILM to manage index size etc. However what happens if I have to update or delete a document in an index that is no longer the hot index? Can I keep all indices as hot, but still use ILM to keep their sizes reasonable?
I have time based data that gets uploaded in blocks. Sometime blocks are missed/lost or fail to upload and get recovered days/weeks later. In this case I need to go insert the data. Presumably data insertion is not a problem, even if out of sequence as it will just write to the current index? Or does it try keep the index sorted based on the indexed fields?
But what happened if I need to up/delete data that has already been moved to another index. The only way I think I can do that is to keep the indices hot?
What am I missing, is there a better way of managing this? The reason I am wanting to merge the indices into 1 is because I have far too many (1800+). So as discussed in the "Previous post" I should move these to a single index and use ILM...
Thanks, your thoughts are appreciated.