# The provided corpus does not match any of the corpora

**URL:** <https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [March 22, 2022, 8:44pm UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385 "2022-03-22T20:44:27Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![mej101](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mej101/32/97686_2.png) [@mej101](https://discuss.elastic.co/u/mej101)\
**Post date:** [March 22, 2022, 8:44pm UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385/1 "2022-03-22T20:44:27Z")

</div>

I've defined one corpus in my track, and when I run the track, I get the message **RallyAssertionError: The provided corpus ['tag-data'] does not match any of the corpora ['tag-data']**. This happens whether or not I explicitly specify `"corpora"` in the bulk operation. Here's my track:

```auto
{% set index_name = (index_name | default("an_index_name")) %}

{
  "version": 0,
  "description": "Reference track",
  "indices": [
    {
      "name": "{{ index_name }}"
    }
  ],
  "corpora": [
    {
      "name": "tag-data",
      "documents": [
        {
          "base-url": "s3://an_s3_url",
          "source-file": "a_text_file.txt.bz2",
          "includes-action-and-meta-data": true,
          "document-count": 368687
        }
      ]
    }
  ],
  "schedule": [
    {
      "operation": {
        "operation-type": "cluster-health",
        "request-params": {
          "wait_for_status": "green"
        },
        "retry-until-success": true
      }
    },
    {
      "operation": {
        "operation-type": "bulk",
        "indices": ["{{ index_name }}"],
        "bulk-size": 5
      },
      "warmup-iterations": 0,
      "clients": 1
    },
    {
      "operation": {
        "operation-type": "force-merge",
        "request-timeout": 7200
      }
    },
    {
      "name": "wait-until-merges-finish",
      "operation": {
        "operation-type": "index-stats",
        "index": "_all",
        "condition": {
          "path": "_all.total.merges.current",
          "expected-value": 0
        },
        "retry-until-success": true,
        "include-in-reporting": false
      }
    }
  ]
}

```

---

<div class="post-metadata">

**Author:** ![Bradley\_Deam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bradley_deam/32/52991_2.png) [@Bradley\_Deam](https://discuss.elastic.co/u/Bradley_Deam)\
**Post date:** [March 23, 2022, 1:09am UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385/2 "2022-03-23T01:09:33Z")

</div>

Hi @mej101 🙂

This looks like a bug, I had a quick look at reproducing this on our current master branch, but I noticed you've specified `version: 0`, and so I get:

```auto
esrally.exceptions.RallyError: Track rally is on version 0 but needs to be updated at least to version 2 to work with the current version of Rally.

```

As we [document here](https://esrally.readthedocs.io/en/stable/track.html#track-elements), you should either omit this (defaults to `version: 2`), or set it explicitly.

Can you please try again without `version: 0`, and can you also please paste the output of:

```auto
$ esrally --version
esrally 2.4.0.dev0 (git revision: 37f4a5f)

```

---

<div class="post-metadata">

**Author:** ![mej101](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mej101/32/97686_2.png) [@mej101](https://discuss.elastic.co/u/mej101)\
**Post date:** [March 23, 2022, 4:51pm UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385/3 "2022-03-23T16:51:43Z")

</div>

Thanks! Same error with `version: 2`, and I get `esrally 2.3.1`. Digging through the source code, it seems it's finding 0 documents in the corpus, and that's why it's returning that error. I tried manually downloading the data to a local folder, and it still finds 0 documents in the corpus.

---

<div class="post-metadata">

**Author:** ![Bradley\_Deam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bradley_deam/32/52991_2.png) [@Bradley\_Deam](https://discuss.elastic.co/u/Bradley_Deam)\
**Post date:** [March 24, 2022, 6:48am UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385/4 "2022-03-24T06:48:51Z")

</div>

Using the same stable release as you, and your track as template, I'm not able to reproduce this.

This is the track I'm using, where `sample-docs-1k.json` is quite literally 1001 lines of `{"message": "in a bottle"}`:

```auto
{% set index_name = (index_name | default("an_index_name")) %}

{
  "description": "Reference track",
  "indices": [
    {
      "name": "{{ index_name }}"
    }
  ],
  "corpora": [
    {
      "name": "tag-data",
      "documents": [
        {
          "source-file": "sample-docs-1k.json",
          "document-count": 1001,
          "includes-action-and-meta-data": false
        }
      ]
    }
  ],
  "schedule": [
    {
      "operation": {
        "operation-type": "cluster-health",
        "request-params": {
          "wait_for_status": "green"
        },
        "retry-until-success": true
      }
    },
    {
      "operation": {
        "operation-type": "bulk",
        "indices": ["{{ index_name }}"],
        "bulk-size": 5
      },
      "warmup-iterations": 0,
      "clients": 1
    },
    {
      "operation": {
        "operation-type": "force-merge",
        "request-timeout": 7200
      }
    },
    {
      "name": "wait-until-merges-finish",
      "operation": {
        "operation-type": "index-stats",
        "index": "_all",
        "condition": {
          "path": "_all.total.merges.current",
          "expected-value": 0
        },
        "retry-until-success": true,
        "include-in-reporting": false
      }
    }
  ]
}

```

This is my invocation:

```auto
esrally race --distribution-version=7.16.1 --track-path /path/to/my/track --kill-running-processes

```

Can you try it with my example above, and also attach the output from `~/.rally/logs/rally.log`?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 21, 2022, 6:48am UTC](https://discuss.elastic.co/t/the-provided-corpus-does-not-match-any-of-the-corpora/300385/5 "2022-04-21T06:48:52Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.