Consider I have created a job today. We will be storing data for only 60 days. On the 61st day, when data is fed to the job, will the job create a new model with the newly fed data or will the job store the past historical data related to the model(and continue modelling newly fed data using the past deleted data)?
The model is cumulative and only needs to see the raw data once, hence on the 61st day, only that data from the 61st day is used by the job. Therefore the maturity of the model can be greater than the retention policy of the index the job is operating on.
So, what you are saying is the job won't create a model for new data based upon past deleted data but only based on current data, right?
What I'm saying is that the model is created from observing all historical data that fed to the job. The model is cumulative and the data only needs to be seen once. When new data comes in the new data updates the model and the model adapts overt ime
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.