# Query parameters for operation-type search

**URL:** <https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [July 18, 2017, 12:32am UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478 "2017-07-18T00:32:48Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![bherring](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bherring/32/20188_2.png) [@bherring](https://discuss.elastic.co/u/bherring)\
**Post date:** [July 18, 2017, 12:32am UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/1 "2017-07-18T00:32:48Z")

</div>

Is it possible to specify one or more query parameters for search operations within track.json?

In my case I'm benchmarking a plug-in that is activated via a query parameter that I defined, e.g.:

GET /\_search?my\_custom\_param=foo  
{  
"query": {  
"match\_all": {}  
}  
}

Is this possible?

Thanks!

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 18, 2017, 10:25am UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/2 "2017-07-18T10:25:01Z")

</div>

Hi @bherring,

since Rally 0.6.1 this is indeed possible. It has been implemented in [#290](https://github.com/elastic/rally/issues/290) where you will find a bit more details.

In your case the syntax is:

```auto
    {
      "name": "default",
      "operation-type": "search",
      "body": {
        "query": {
          "match_all": {}
        }
      },
      "request-params": {
        "my_custom_param": "foo",
      }
    }

```

Daniel

---

<div class="post-metadata">

**Author:** ![bherring](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bherring/32/20188_2.png) [@bherring](https://discuss.elastic.co/u/bherring)\
**Post date:** [July 18, 2017, 2:58pm UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/3 "2017-07-18T14:58:22Z")

</div>

Thanks for the quick response!

I upgraded to 0.6.2 and added the "request-params" specifier to my track.json as you described, and re-ran my race.

An exception was raised at [racecontrol.py](http://racecontrol.py), line 164 related to "unexpected keyword", as if it doesn't like my custom query parameter. I double-checked that the same query is working fine when requested outside of esrally.

Below is a snippet from the generated log showing the exception. I'd be happy to send you the full log but it is too long to paste inline and the upload feature doesn't allow text files.

Thanks again!

* * *

2017-07-18 14:38:04,928 PID:61499 root ERROR Cannot run subcommand [race].  
Traceback (most recent call last):  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 241, in race  
may\_continue = benchmark.run(lap)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 164, in run  
raise exceptions.RallyError(result.message, result.cause)  
esrally.exceptions.RallyError: ('Error in load generator [0]', TypeError("search() got an unexpected keyword argument 'rba\_list'",))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/rally.py", line 446, in dispatch\_sub\_command  
race(cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/rally.py", line 380, in race  
with\_actor\_system(lambda c: racecontrol.run(c), cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/rally.py", line 400, in with\_actor\_system  
runnable(cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/rally.py", line 380, in   
with\_actor\_system(lambda c: racecontrol.run(c), cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 340, in run  
raise e  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 337, in run  
pipeline(cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 42, in **call**  
self.target(cfg)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 285, in benchmark\_only  
return race(Benchmark(cfg, external=True))  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 250, in race  
benchmark.teardown(cancelled, error)  
File "/home/m2/.local/lib/python3.4/site-packages/esrally/racecontrol.py", line 183, in teardown  
raise exceptions.RallyError("Mechanic has not stopped engine but instead [%s]. Terminating race without result." % str(result))  
esrally.exceptions.RallyError: Mechanic has not stopped engine but instead [\<esrally.driver.driver.BenchmarkFailure object at 0x7f4efe0024a8\>]. Terminating race without result.

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 18, 2017, 4:26pm UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/4 "2017-07-18T16:26:18Z")

</div>

Hi @bherring,

I could reproduce the issue.

The reason Rally is using the official Elasticsearch Python client to issue requests against Elasticsearch. Prior to creating the request, the client checks that the passed request parameters match one of the [parameters in the documentation](http://elasticsearch-py.readthedocs.io/en/master/api.html#elasticsearch.Elasticsearch.search). As your request parameter `rba_list` is a non-standard one, it fails the validation and thus the benchmark fails.

I see if I can get around that limitation somehow but I fear it's gonna take a little while.

If it's very important to you, you can write a [custom runner](http://esrally.readthedocs.io/en/latest/adding_tracks.html#custom-runners) for this operation and basically use a low-level method of the Python client.

Something along these lines should do what you want:

```auto
# instead of self.es.search(...) do:
import elasticsearch.client
self.es.transport.perform_request("GET", elasticsearch.client._make_path(index, type, '_search'), params=your_request_parameter_map_here, body=body)

```

but obviously this is more fragile than relying on the standard mechanisms.

Daniel

---

<div class="post-metadata">

**Author:** ![bherring](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bherring/32/20188_2.png) [@bherring](https://discuss.elastic.co/u/bherring)\
**Post date:** [July 18, 2017, 4:42pm UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/5 "2017-07-18T16:42:03Z")

</div>

Thank you Daniel that is very helpful. If there is a way around this from your side I think that would be worth doing (for future search plug-in developers like me). Meanwhile I'll try out your suggestion of creating a custom runner.

---

<div class="post-metadata">

**Author:** ![bherring](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bherring/32/20188_2.png) [@bherring](https://discuss.elastic.co/u/bherring)\
**Post date:** [July 18, 2017, 9:07pm UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/6 "2017-07-18T21:07:04Z")

</div>

Daniel your suggestion worked great, thanks!

Here is what my [track.py](http://track.py) looks like, just in case this might be useful to others....

import elasticsearch.client

def search\_custom(es, params):  
es.transport.perform\_request("GET",  
elasticsearch.client.\_make\_path(  
params["index"],  
params["type"],  
'\_search'),  
params=params["request-params"],  
body=params["body"]  
)

def register(registry):  
registry.register\_runner("search\_custom", search\_custom)

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [July 19, 2017, 5:45am UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/7 "2017-07-19T05:45:19Z")

</div>

Hi Brian,

for the moment I'd stick to the custom runner as this gives you the most control (glad to hear that it works 🙂 ). To allow this in Rally core at some point I've raised [#302](https://github.com/elastic/rally/issues/302) in the Rally repo.

Daniel

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 16, 2017, 5:45am UTC](https://discuss.elastic.co/t/query-parameters-for-operation-type-search/93478/8 "2017-08-16T05:45:51Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.