Summarized timeseries data creation using timesearies data in one index to another index

Elastic Stack Elasticsearch
1

Is there a feature available where time series based data could be aggregated for all fields of an index and and stored as another aggregated document in another index. To elaborate, say index1 has time series data and it is collected every 5 seconds for numeric fields nfield1, nfield2 and nfield3 and some text fields (which can be used for grouping the documents aggregation on these numeric fields).

In summarized index I want to keep data at much coarse granularity over time. Say these numeric fields are aggregated (could be average value by each hour or day or week). Thus summarized index contains one document (for the grouping used) instead of 1260 raw documents stored for one hour period in original time series based index or 1260*24 documents averaged for one day creating one document for quick access and trending from summarized/aggregated index instead of computing on fly for different aggregation periods.

2

At the moment, no, there isn't a feature that does this.... you'll have to do the pre-aggregating yourself (either at ingest time, or later via aggregatinos) and store the results.

It's something we've been talking though, and would like to offer some kind of functionality to do it. No hard roadmap plans yet.

3

Thanks for info. It will be useful when historical trends need to be plotted over long duration. For example precision to seconds level is not required when plotting data over multiple months. I would love to see this feature included.From: elastic@discoursemail.comSent: March 30, 2017 12:15 PMTo: ajay.bh111@gmail.comReply-to: elastic+42ded5f4cdc6af4286ff47cf9eea81c8@discoursemail.comSubject: [Elasticsearch] Summarized timeseries data creation using timesearies data in one index to another index

polyfractalZachary TongElasticsearch Developer

March 30

At the moment, no, there isn't a feature that does this.... you'll have to do the pre-aggregating yourself (either at ingest time, or later via aggregatinos) and store the results.

It's something we've been talking though, and would like to offer some kind of functionality to do it. No hard roadmap plans yet.

Visit Topic or reply to this email to respond.

To unsubscribe from these emails, click here.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.