# Rally for aggregations on existing ES cluster
**URL:** https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019
**Category:** Elasticsearch
**Tags:** rally
**Created:** [August 13, 2019, 12:04pm UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019 "2019-08-13T12:04:37Z")
**Posts on this page:** 8
**Page:** 1
### Author:  [@rajgurinder](https://discuss.elastic.co/u/rajgurinder)
#### Post date: [August 13, 2019, 12:04pm UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/1 "2019-08-13T12:04:37Z")
Hi
I have an existing ElasticSearch Cluster with 36 Data Nodes and 5 Masters.
Our Main Use case is search + **aggregations(alot)**
It frequency goes to RED state with some concurrent requests.
After reading many blogs, I suspect some of the settings we have done are wrong.
In order to test the performance of ES after tweaking those settings , I am thinking of using rally.
So I have 2 questions:-
1. Is Rally the right tool for this?
2. How can I create a test-track which has only search+ **aggregation** queries.
Please note: I found some articles on search queries but none on Aggregations Queries.
Any help is appreciated.
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 14, 2019, 8:28am UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/2 "2019-08-14T08:28:12Z")
Running benchmarks against existing clusters with existing indices is in my opinion a very common use-case and I wish there was a proper example of this in the docs. I believe Rally still requires some index specifications even if they are not used, so it is possible to create a slimmed down challenge to do exactly what you are requesting. In order to create complex queries and the distribution of query parameters, you may need to create a custom parameter source in Python. An example of how to create complex multisearch queries with aggregations can be found[in the rally-eventdata-track where it is ued to simulate Kibana queries](https://github.com/elastic/rally-eventdata-track/blob/master/eventdata/parameter_sources/elasticlogs_kibana_source.py).
---
### Author:  [@rajgurinder](https://discuss.elastic.co/u/rajgurinder)
#### Post date: [August 19, 2019, 12:21pm UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/3 "2019-08-19T12:21:37Z")
Thanks Christian.
I will look into it.
Yea you rightly said, there are no proper examples of a very common use case - benchmarking existing cluster
---
### Author:  [@dliappis](https://discuss.elastic.co/u/dliappis)
#### Post date: [August 20, 2019, 9:02am UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/4 "2019-08-20T09:02:04Z")
Hey @Christian_Dahlqvist !
re: examples of running benchmarks against an existing cluster there is: [https://esrally.readthedocs.io/en/stable/recipes.html#benchmarking-an-existing-cluster](https://esrally.readthedocs.io/en/stable/recipes.html#benchmarking-an-existing-cluster)
Is this sufficient, or is there something missing in your opinion?
Dimitris
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 20, 2019, 9:38am UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/5 "2019-08-20T09:38:56Z")
What I am looking for is a guide on how to create a custom track that will run custom queries against an existing cluster with existing data. This is something I have not found documented very well.
---
### Author:  [@rajgurinder](https://discuss.elastic.co/u/rajgurinder)
#### Post date: [August 20, 2019, 11:58am UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/6 "2019-08-20T11:58:44Z")
Hi Liappis
Yes what Christian mentioned is exactly what we are looking for.
It would be very helpful if the same can be closed soon.
---
### Author:  [@dliappis](https://discuss.elastic.co/u/dliappis)
#### Post date: [August 22, 2019, 1:26pm UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/7 "2019-08-22T13:26:50Z")
I forgot to mention that a very minimal example of a query-only track that doesn't do any index creation can be found in: [https://esrally.readthedocs.io/en/stable/track.html#a-track-with-a-single-task](https://esrally.readthedocs.io/en/stable/track.html#a-track-with-a-single-task).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 19, 2019, 1:26pm UTC](https://discuss.elastic.co/t/rally-for-aggregations-on-existing-es-cluster/195019/8 "2019-09-19T13:26:56Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.