I have a quick question - How you guys handle working with histogram aggregation on very large datasets? When I display the same histogram on like < 7 days there's no performance issue at all.
However, the larger the time range I set, the more time it takes to get the results. Is it a common practice to store aggregated result in MySQL when it has already been processed by ElasticSearch to improve performance?
- We have a cluster of 3 nodes, 8 GB of RAM each.
- We have a monthly index rotation with 45 million documents in each one.
- 4 CPU Core for each node.