I want to index time series data for long-term in searchable status over 5 years.
Data sampled about half an hour were indexed into 5GB data(1,000,000 documents).
I think long-term aggregation based on these dataset have many performance issue. And I try to intermediate aggregation per minutely/hourly/daily/... and index it.
However I am not very sure if this component suits the elastic search environment.
Please share your experience and any idea if you have used similar components or had similar issue with me.