We are considering storing Historical data in ES. Is there any pattern or best practice guideline defined for this?
The way we want to do this is via a scheduled job that will pull data on a defined interval and store in Index. So one document will exist multiple times inside a mapping. We will add a timestamp to identify when the document was loaded in ES.
In such a scenario what should the _id be defined as?
Also any suggestions regarding storing historical data in ES will be helpful.