I'm working on a use case where I need to perform aggregations for charting on a 500 billion documents.
The data is related to some sales.
I have evaluated the data size as 8 mb for 24000 documents on my local machine.
Please help me in working with such data. My queries are
- does elastic search scale for such type aggregation quries for this data size?
- I'm looking for a response time of these aggregation quries at max as 3 sec.
- How much of hard ware do I need to invest, any link to calculate this?