# Event-data-track from github does not work

**URL:** <https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [March 28, 2019, 10:08am UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298 "2019-03-28T10:08:28Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![asp](https://avatars.discourse-cdn.com/v4/letter/a/9fc348/32.png) [@asp](https://discuss.elastic.co/u/asp)\
**Post date:** [March 28, 2019, 10:08am UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/1 "2019-03-28T10:08:28Z")

</div>

Hi,

I have issues running the event-data-track from github by  
@Christian_Dahlqvist.

I modified my rally.ini in tracks area to this here:

```
[tracks]
default.url = https://github.com/elastic/rally-tracks
eventdata.url = https://github.com/elastic/rally-eventdata-track

```

I start rally with the following command:

```
esrally --offline --target-hosts=qdetjt:9200 --pipeline=benchmark-only --user-tag=testrunName:volume_106,cluster:volume,env:docker,ver:6.6.2,JMS:4g,JMX:4g,laps:1,storageType:volume,StorageDriver:overlay2,aloneOnLoadGenerator:yes,Iteration:106 --laps=1 --track-path=/home/esrally/.rally/benchmarks/tracks/rally-eventdata-track/eventdata/

```

Rally is comming that far:

```
[INFO] Racing on track [eventdata], challenge [append-no-conflicts] and car ['external'] with version [6.6.2].

Running delete-index [100% done]
Running create-index [100% done]
Running index-append-1000 [2% done]

```

rally.log is showing things like that:

```
2019-03-28 09:38:16,770 ActorAddr-(T|:39104)/PID:41979 esrally.actor INFO LoadGenerator[0] starts driving now.
2019-03-28 09:38:16,774 ActorAddr-(T|:38825)/PID:41968 esrally.actor INFO Resetting relative time of cluster system metrics store.
2019-03-28 09:38:16,777 ActorAddr-(T|:37645)/PID:41976 esrally.actor INFO Resetting relative time of system metrics store on host [[{'port': 9200, 'host': 'qdetjt'}]].
2019-03-28 09:38:16,765 ActorAddr-(T|:37424)/PID:41985 esrally.actor INFO LoadGenerator[6] is executing [index-append-1000].
2019-03-28 09:38:16,764 ActorAddr-(T|:35043)/PID:41983 esrally.actor INFO LoadGenerator[4] is executing [index-append-1000].
2019-03-28 09:38:16,765 ActorAddr-(T|:35043)/PID:41983 esrally.driver.driver INFO Choosing [deterministic scheduler] for [index-append-1000].
2019-03-28 09:38:30,45 ActorAddr-(T|:35043)/PID:41983 esrally.driver.driver INFO Creating time-period based schedule with [deterministic] distribution for [index-append-1000] with a warmup period of [0] seconds and a time period of [1200] seconds.
2019-03-28 09:38:16,766 ActorAddr-(T|:37424)/PID:41985 esrally.driver.driver INFO Choosing [deterministic scheduler] for [index-append-1000].
2019-03-28 09:38:30,43 ActorAddr-(T|:37424)/PID:41985 esrally.driver.driver INFO Creating time-period based schedule with [deterministic] distribution for [index-append-1000] with a warmup period of [0] seconds and a time period of [1200] seconds.
2019-03-28 09:38:30,226 -not-actor-/PID:41983 elasticsearch WARNING POST http://qdetjt:9200/_bulk [status:400 request:0.098s]
2019-03-28 09:38:30,227 -not-actor-/PID:41985 elasticsearch WARNING POST http://qdetjt:9200/_bulk [status:400 request:0.108s]
2019-03-28 09:38:30,352 -not-actor-/PID:41985 elasticsearch WARNING POST http://qdetjt:9200/_bulk [status:400 request:0.055s]
2019-03-28 09:38:30,352 -not-actor-/PID:41983 elasticsearch WARNING POST http://qdetjt:9200/_bulk [status:400 request:0.050s]
2019-03-28 09:38:30,478 -not-actor-/PID:41985 elasticsearch WARNING POST http://qdetjt:9200/_bulk [status:400 request:0.053s]
```

---

<div class="post-metadata">

**Author:** ![asp](https://avatars.discourse-cdn.com/v4/letter/a/9fc348/32.png) [@asp](https://discuss.elastic.co/u/asp)\
**Post date:** [March 28, 2019, 10:11am UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/2 "2019-03-28T10:11:39Z")

</div>

elasticsearch is showing this exception after starting esrally:

> **[View Paste iXFch](https://paste.ee/p/iXFch)**
>
> Paste.ee - View Paste iXFch

That error of the last lines is flooding the log.

My external car is standard single node cluster with 4GB Xmx.

Thanks for any help,  
Andreas

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [March 28, 2019, 1:28pm UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/3 "2019-03-28T13:28:19Z")

</div>

Hi,

you're refering to the track with `--track-path` and this means you're effectively disabling Rally's ability to pick the right version of the track based on the Elasticsearch version you're benchmarking. So your benchmark ran against the `master` branch of the track repo which is suitable for Elasticsearch 7.0.0 and better and this is why you get failures.

You should instead use `--track-repository=eventdata --track=eventdata` then Rally will recognize that you are benchmarking Elasticsearch 6.x and that there is a branch `6` in that repo which it will then checkout. For more details please see the [docs](https://esrally.readthedocs.io/en/stable/track.html#track-file-format-and-storage).

Daniel

---

<div class="post-metadata">

**Author:** ![asp](https://avatars.discourse-cdn.com/v4/letter/a/9fc348/32.png) [@asp](https://discuss.elastic.co/u/asp)\
**Post date:** [April 2, 2019, 6:59am UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/4 "2019-04-02T06:59:15Z")

</div>

thanks, it's now working.

What is the best practice to test on an air-gap system? Can I just run it once (with same target cluster version) on an on-air system, then copy the track repository to the air gap system?

Is rally only interacting different with ES by each major or also on each minor or bugfix version?

Thanks a lot,  
Andreas

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [April 4, 2019, 3:23pm UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/5 "2019-04-04T15:23:50Z")

</div>

> [@asp](#):
>
> What is the best practice to test on an air-gap system? Can I just run it once (with same target cluster version) on an on-air system, then copy the track repository to the air gap system?

For our standard tracks we actually have a helper script (see [docs](https://esrally.readthedocs.io/en/stable/offline.html#using-tracks)). For the rally-evendata-track I suggest you clone the Github repo on a machine with Internet access and then transfer the entire repository to the machine where you run the benchmarks. All the branches are already available locally then and Rally will just check them out. But note that to get any new commits containing fixes or new features you need to transfer the repo again yourself.

> [@asp](#):
>
> Is rally only interacting different with ES by each major or also on each minor or bugfix version?

That depends and you need to check the respective track repo. In rally-tracks we sometimes have branches even for minor versions (see the [versioning scheme docs](https://github.com/elastic/rally-tracks/#versioning-scheme)). The eventdata track does not offer as thorough multi-version support as the standard tracks though (IIRC versions below Elasticsearch 6.x are not supported nor is there an intention to do so).

Daniel

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 2, 2019, 3:23pm UTC](https://discuss.elastic.co/t/event-data-track-from-github-does-not-work/174298/6 "2019-05-02T15:23:52Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
