# Aggregations for charting on 500 billion documents

**URL:** <https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197>\
**Category:** Elasticsearch\
**Created:** [March 20, 2017, 4:53am UTC](https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197 "2017-03-20T04:53:58Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![goutham\_pn](https://avatars.discourse-cdn.com/v4/letter/g/ea666f/32.png) [@goutham\_pn](https://discuss.elastic.co/u/goutham_pn)\
**Post date:** [March 20, 2017, 4:53am UTC](https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197/1 "2017-03-20T04:53:58Z")

</div>

Hello,

I'm working on a use case where I need to perform aggregations for charting on a 500 billion documents.

The data is related to some sales.

I have evaluated the data size as 8 mb for 24000 documents on my local machine.

Please help me in working with such data. My queries are

1. does elastic search scale for such type aggregation quries for this data size?
2. I'm looking for a response time of these aggregation quries at max as 3 sec.
3. How much of hard ware do I need to invest, any link to calculate this?

Thanks

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 20, 2017, 4:56am UTC](https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197/2 "2017-03-20T04:56:30Z")

</div>

1. What is huge?
2. Ok.
3. You need to test based on your queries and document structures.

---

<div class="post-metadata">

**Author:** ![goutham\_pn](https://avatars.discourse-cdn.com/v4/letter/g/ea666f/32.png) [@goutham\_pn](https://discuss.elastic.co/u/goutham_pn)\
**Post date:** [March 20, 2017, 5:06am UTC](https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197/3 "2017-03-20T05:06:06Z")

</div>

Hi Warkolm,

My data format is,

{  
"id": "abc23",  
"suId": 7,  
"sDate": 1489807182683,  
"cDate": 1489807182683,  
"unitsSold": 9,  
"revenue": 18,  
"pou": 811,  
"margin": 2,  
"not": 6,  
"woty": 11,  
"zc": 599906,  
"strId": 5  
}

My sql quries will be some think like this  
select suid, sum(revenue) where zc="599906" group by suid, sdate  
select suid, avg(margin) where zc="599906" group by suid , sdate

Similar kind of queries I want to use with ES.

Please let me know if you want more information on this.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 17, 2017, 5:06am UTC](https://discuss.elastic.co/t/aggregations-for-charting-on-500-billion-documents/79197/4 "2017-04-17T05:06:08Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.