# Can elastic/rally point to existing ES configurations for benchmarking

**URL:** https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627
**Category:** Elasticsearch
**Tags:** rally
**Created:** [July 28, 2016, 12:55pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627 "2016-07-28T12:55:04Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![paulbarr](https://avatars.discourse-cdn.com/v4/letter/p/ac91a4/32.png) [@paulbarr](https://discuss.elastic.co/u/paulbarr)
#### Post date: [July 28, 2016, 12:55pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/1 "2016-07-28T12:55:04Z")

</div>

Hey,  
I looking at doing some bench marking for different ElasticSearch cluster configurations  
I've seen this: [https://github.com/elastic/rally](https://github.com/elastic/rally)

It says that when you kick it off it downloads the benchmark data, pulls down the latest Elastic version and executes the benchmark.

I want to run the benchmark against an existing ES cluster configured one way, then run it again against a clsuter configured a different way. Is it possible to do this with Rally?

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [July 28, 2016, 1:39pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/2 "2016-07-28T13:39:39Z")

</div>

Hi @paulbarr,

this is kind of doable but not so convenient. The situation is similar to what we had with tracks a few weeks ago. You have basically two options:

1. [Install Rally in development mode](http://esrally.readthedocs.io/en/latest/developing.html), open `car.py` and configure the "cars" you need (we call an Elasticsearch configuration a "car"). Note that this is currently limited but we'll eventually allow you to configure it much more flexible.
2. Don't have Rally provision your cluster but instead to it manually and point Rally to your cluster by using the [pipeline `benchmark-only`](https://esrally.readthedocs.io/en/latest/pipelines.html#benchmark-only)

Just let me know if you need further help.

Daniel

Daniel

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [July 28, 2016, 1:41pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/3 "2016-07-28T13:41:36Z")

</div>

Hi,

One small addition: If you use the second approach with the pipeline `benchmark-only` (which seems to be more likely to me in your scenario), please ensure that you use Rally 0.3.1. (released yesterday) as I've fixed a related bug there.

Daniel

---

<div class="post-metadata">

### Author: ![paulbarr](https://avatars.discourse-cdn.com/v4/letter/p/ac91a4/32.png) [@paulbarr](https://discuss.elastic.co/u/paulbarr)
#### Post date: [July 28, 2016, 3:20pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/4 "2016-07-28T15:20:57Z")

</div>

Hey,  
Thanks for the information. Option 2 looks like it might work well for us.  
Will this work with older versions of ElasticSearch? We currently use ES version: 2.2.0

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [July 28, 2016, 3:40pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/5 "2016-07-28T15:40:43Z")

</div>

Hi @paulbarr,

yes, if you use the standard "tracks" (benchmarks). We have created them in a way so they support all versions between ES 1.7 and the latest 5.0 builds.

Daniel

---

<div class="post-metadata">

### Author: ![paulbarr](https://avatars.discourse-cdn.com/v4/letter/p/ac91a4/32.png) [@paulbarr](https://discuss.elastic.co/u/paulbarr)
#### Post date: [July 28, 2016, 3:42pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/6 "2016-07-28T15:42:17Z")

</div>

Thanks Daniel,

This looks like the right option for us now - we'll grab it down and try it out

---

<div class="post-metadata">

### Author: ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)
#### Post date: [January 10, 2017, 10:10am UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/7 "2017-01-10T10:10:08Z")

</div>

Hi,

just starting out with esrally to test several deployment configurations on kubernetes...

I'm mainly playing with Heapsize, memory limits and requests to see how/if they affect performance.

These are the steps I follow to run the benchmarks: [https://github.com/honestbee/docker-esrally](https://github.com/honestbee/docker-esrally)

I'm always using an external cluster (benchmark-only) and in between races I change the deployment parameters (which destroys the old master/data/client nodes and creates new nodes)...

I'm able to list the races, comparing 2 races completes "successfully" - but it doesn't show any metrics... please let me know what more information you need?

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [January 10, 2017, 10:12am UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/8 "2017-01-10T10:12:38Z")

</div>

Hi @so0k,

can you please create a new topic to discuss this?

Daniel

---

<div class="post-metadata">

### Author: ![so0k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/so0k/32/14422_2.png) [@so0k](https://discuss.elastic.co/u/so0k)
#### Post date: [January 10, 2017, 10:14am UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/9 "2017-01-10T10:14:23Z")

</div>

sure, I didn't want to flood the forum with similar topics, I thought this was a follow on to testing external clusters ~ running tournaments for external clusters.

I'll create another topic

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [January 10, 2017, 10:21am UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/10 "2017-01-10T10:21:05Z")

</div>

Thanks! 🙂

---

<div class="post-metadata">

### Author: ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)
#### Post date: [January 10, 2017, 5:09pm UTC](https://discuss.elastic.co/t/can-elastic-rally-point-to-existing-es-configurations-for-benchmarking/56627/11 "2017-01-10T17:09:29Z")

</div>


