# Esrally run failed for "Cannot find documents-2.json.bz2"

**URL:** <https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [June 23, 2018, 7:55am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109 "2018-06-23T07:55:32Z")\
**Posts on this page:** 15\
**Page:** 3

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 3, 2018, 1:59pm UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/41 "2018-07-03T13:59:59Z")

</div>

> [@Jessica254](#):
>
> I have cleaned the modification, and there's only branch master.

Hi,

this means that your clone is - for some reason - not containing all branches. How did you clone the repository? If you have used the download script, it should actually contain all branches, not just master. Can you please clone the repo on a machine with Internet access?

```auto
git clone https://github.com/elastic/rally-tracks.git

```

And then transfer your clone to the target machine? It is important that it contains all branches. Then you will be able to benchmark also Elasticsearch 2.

Daniel

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 4, 2018, 1:13am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/42 "2018-07-04T01:13:05Z")

</div>

Umm,unfortunately our company is not permitted for internet access.😭  
Could I get it through browser?

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 4, 2018, 4:04am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/43 "2018-07-04T04:04:59Z")

</div>

So you are behind a proxy? But you are still allowed to browse https sites I'd assume? You just need to configure git so it uses your proxy. Then the above command should work just fine. See for example [this proxy configuration howto](https://gist.github.com/evantoli/f8c23a37eb3558ab8765).

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 4, 2018, 5:47am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/44 "2018-07-04T05:47:54Z")

</div>

I can't get access to the link you gave:crying\_cat\_face:  
could you paste the manual here please?  
thank you so much:kissing\_cat:

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 4, 2018, 6:28am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/45 "2018-07-04T06:28:41Z")

</div>

The tl;dr is that you need to configure the proxy like this:

```auto
git config --global http.proxy http://proxyUsername:proxyPassword@proxy.server.com:port

```

where you need to replace `proxyUsername`, `proxyPassword`, `proxy.server.com` and `port` with your proxy server configuration.

If you get SSL errors, you might also need to set:

```auto
git config --global http.sslVerify false

```

The full reference is at [https://git-scm.com/docs/git-config](https://git-scm.com/docs/git-config) (which I really hope you are able to open).

If that is still not working you need to find a machine where you can issue this command:

```auto
git clone https://github.com/elastic/rally-tracks.git default

```

and then transfer the complete contents of the directory `default` to `~/.rally/benchmarks/tracks` on the target machine. Before you did not solve this issue, there is no point in continuing benchmarking.

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 16, 2018, 6:23am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/46 "2018-07-16T06:23:22Z")

</div>

I execute command as following:  
git config --global user.email [zhengshan@hikvision.com](mailto:zhengshan@hikvision.com)

but still, it does not work.  
and here's no machine that can access to network, OMG!😥

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 16, 2018, 7:03am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/47 "2018-07-16T07:03:22Z")

</div>

> [@danielmitterdorfer](#):
>
> `~/.rally/benchmarks/tracks`

I have downloaded the default folder by other's help. 😀  
But still it failed by running esrally command.

Running create-index [0% done]  
[ERROR] Cannot race. Error in load generator [0]  
Request returned an error. Error type: transport, Description: mapper\_parsing\_exception ({'error': {'root\_cause': [{'type': 'mapper\_parsing\_exception', 'reason': 'No handler for type [text] declared on field [admin1\_code]'}], 'type': 'mapper\_parsing\_exception', 'reason': 'Failed to parse mapping [type]: No handler for type [text] declared on field [admin1\_code]', 'caused\_by': {'type': 'mapper\_parsing\_exception', 'reason': 'No handler for type [text] declared on field [admin1\_code]'}}, 'status': 400})

Getting further help:

* * *

- Check the log files in /root/.rally/logs for errors.
- Read the documentation at [Rally 0.11.0 — Rally 0.11.0 documentation](https://esrally.readthedocs.io/en/0.11.0/)
- Ask a question on the forum at [https://discuss.elastic.co/c/elasticsearch/rally](https://discuss.elastic.co/c/elasticsearch/rally)
- Raise an issue at [Issues · elastic/rally · GitHub](https://github.com/elastic/rally/issues) and include the log files in /root/.rally/logs.

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 16, 2018, 11:09am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/48 "2018-07-16T11:09:37Z")

</div>

Hi,

the `text` mapping type was introduced in Elasticsearch 5.0 so there is still a problem with the repository. There is one workaround: You can download also a single branch of a repo from Github. For Elasticsearch 2.x you need the branch "2". You can download just this branch via any browser: [https://github.com/elastic/rally-tracks/archive/2.zip](https://github.com/elastic/rally-tracks/archive/2.zip)

Extract this anywhere on your file system, e.g. to `~/my-tracks/default/2`. If you do it like this, you need to specify `--track-path=~/my-tracks/default/2/geonames` instead of `--track=geonames`. This is definitely not ideal because benchmarking across major versions of Elasticsearch gets more complicated (you need to download and refer to each branch separately instead of having Rally do this for you) but I fear there is no way around this in your environment.

Daniel

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 17, 2018, 2:59am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/49 "2018-07-17T02:59:58Z")

</div>

Exactly, I don't know why I need to download the ES2.X, for in my env, I installed the ES5.x actually.

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 17, 2018, 5:36am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/50 "2018-07-17T05:36:02Z")

</div>

> [@Jessica254](#):
>
> I don't know why I need to download the ES2.X, for in my env, I installed the ES5.x actually.

You do not need to use Elasticsearch 2.x. Based on the output of the error message I've assumed that you run (and want to run) an older version of Elasticsearch than 5.0. It seems to me that Rally is pointed to an older cluster.

In "[Esrally run failed for "Cannot find documents-2.json.bz2" - #2 by Jessica254](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/2)" you mentioned that you invoke Rally like this:

```auto
esrally --track=geonames --target-hosts=10.3.68.168:9200,10.3.68.172:9200,10.3.68.174:9200 --challenge=append-no-conflicts-index-only --pipeline=benchmark-only --offline

```

1. How did you install Elasticsearch?
2. How and on which machine do you start it (IP address and port)? Is it still `10.3.68.168:9200,10.3.68.172:9200,10.3.68.174:9200`?
3. What does the output of `curl -X GET "http://10.3.68.168:9200/?pretty"` show?

Daniel

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 17, 2018, 5:54am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/51 "2018-07-17T05:54:01Z")

</div>

> [@danielmitterdorfer](#):
>
> This is definitely not ideal because benchmarking across major versions of Elasticsearch gets more complicated (you need to download and refer to each branch separately instead of having Rally do this for you) but I fear there is no way around this in your environment.

I'm so sorry that it seems I have confused the ES version and ESRally verison. 😅  
My ES is 2.X:  
[root@hdh154 ~]# curl -X GET "[http://10.3.68.168:9200/?pretty](http://10.3.68.168:9200/?pretty)"  
{  
"name" : "hdh168",  
"cluster\_name" : "SERVICE-ELASTICSEARCH-d491f3f7ba9740cdbb4aa4061df99a01",  
"version" : {  
"number" : "2.3.5",  
"build\_hash" : "${buildNumber}",  
"build\_timestamp" : "2017-09-18T03:13:06Z",  
"build\_snapshot" : false,  
"lucene\_version" : "5.5.0"  
},  
"tagline" : "You Know, for Search"  
}

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 17, 2018, 6:26am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/52 "2018-07-17T06:26:15Z")

</div>

> [@danielmitterdorfer](#):
>
> --track-path

## and it seems OK, thank you so much for your patient and professional knowledge. 😁

```
_________  _____                    

```

## / _**()**_ \_\_\_\_ _/ / / **/** _\_\_\_\_\_ \_\_\_\_\_\_\_\_ / /\_ / / \_\_ / \_\_ `/ / \_\_ / _/ \_\_ / / \_ / \_\_/ / / / / / // / / **/ / /** / // / / / \_\_/ // /// //\ __,_/_/ /\_\__ /\_ **/\_** /_/ \_\_\_/

| Lap | Metric | Task | Value | Unit |
| --- | --- | --- | --- | --- |
| All | Indexing time | | 53.9759 | min |
| All | Indexing throttle time | | 0 | min |
| All | Merge time | | 17.2582 | min |
| All | Refresh time | | 2.39667 | min |
| All | Flush time | | 0.0985167 | min |
| All | Merge throttle time | | 4.9892 | min |
| All | Total Young Gen GC | | 21.712 | s |
| All | Total Old Gen GC | | 0 | s |
| All | Store size | | 6.2586 | GB |
| All | Translog size | | 2.23061e-05 | GB |
| All | Heap used for segments | | 44.7892 | MB |
| All | Heap used for doc values | | 0.160641 | MB |
| All | Heap used for terms | | 43.7278 | MB |
| All | Heap used for norms | | 0.108276 | MB |
| All | Heap used for stored fields | | 0.792473 | MB |
| All | Segment count | | 141 | |
| All | Min Throughput | index-append | 66611.1 | docs/s |
| All | Median Throughput | index-append | 66827.7 | docs/s |
| All | Max Throughput | index-append | 67196.6 | docs/s |
| All | 50th percentile latency | index-append | 551.143 | ms |
| All | 90th percentile latency | index-append | 630.469 | ms |
| All | 99th percentile latency | index-append | 1148.01 | ms |
| All | 100th percentile latency | index-append | 1319.46 | ms |
| All | 50th percentile service time | index-append | 551.143 | ms |
| All | 90th percentile service time | index-append | 630.469 | ms |
| All | 99th percentile service time | index-append | 1148.01 | ms |
| All | 100th percentile service time | index-append | 1319.46 | ms |
| All | error rate | index-append | 0 | % |

* * *

## [INFO] SUCCESS (took 202 seconds)

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 17, 2018, 7:13am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/53 "2018-07-17T07:13:25Z")

</div>

Hi,

that looks good indeed. 🙂 Glad we made it now. Just remember that you need to take care now if you want to benchmark a different (major) version of Elasticsearch because the version that you reference now via `--track-path` only works for Elasticsearch 2.x.

Daniel

---

<div class="post-metadata">

**Author:** ![Jessica254](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jessica254/32/32909_2.png) [@Jessica254](https://discuss.elastic.co/u/Jessica254)\
**Post date:** [July 17, 2018, 7:33am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/54 "2018-07-17T07:33:43Z")

</div>

OK, get it. Maybe I'll meet some other problem when I use ES5.X, then will trouble you again. 😜

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 14, 2018, 7:33am UTC](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109/55 "2018-08-14T07:33:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/esrally-run-failed-for-cannot-find-documents-2-json-bz2/137109.md?page=2)
