# Painless QA query

**URL:** <https://discuss.elastic.co/t/painless-qa-query/154883>\
**Category:** Elasticsearch\
**Created:** [October 31, 2018, 4:21pm UTC](https://discuss.elastic.co/t/painless-qa-query/154883 "2018-10-31T16:21:03Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![lask001](https://avatars.discourse-cdn.com/v4/letter/l/4da419/32.png) [@lask001](https://discuss.elastic.co/u/lask001)\
**Post date:** [October 31, 2018, 4:21pm UTC](https://discuss.elastic.co/t/painless-qa-query/154883/1 "2018-10-31T16:21:03Z")

</div>

I'm trying to QA some documents with painless, hoping I could get a little help on what I'm doing wrong why my query.

I have about a billion documents that are being used for application search. During the loading process, there were some errors on the codes and one of the fields wasn't populated with the correct values. Lucky for us, it's something we can abstract the value of from other fields. I realize that it would probably be better for the application to put this together but this is what I'm stuck making work. Here's an example of what the docs should look like before and after:

Before:

```
{
  "field_one": "foo",
  "field_two": "bar",
  "field_three": "error"
}

```

Before:

```
{
  "field_one": "foo",
  "field_two": "bar",
  "field_three": "foo bar"
}

```

I was able to fix the fields with an update by query and am very happy with those results. My issue is I don't always know what's in field three as the data that was incorrectly populated isn't consistent.

This may not be the best approach, but what I would like to do is write a query that finds all documents that do not match what the constructed field would be after the update. I was trying to use painless to build what the actual value would be and then do a bool query so I could include or exclude those values to push the updates. Any suggestions on what is wrong with my syntax below and why it's not working for me? I'd also be interested if anyone has a better way to go about doing this - thanks!

```
{
  "query": {
    "bool": {
      "must": {
        "script": {
          "script": {
            "source": "ctx._source.field_three = ctx._source.field_one + ctx._source.field_two",
            "lang": "painless"
          }
        }
      }
    }
  }
}
```

---

<div class="post-metadata">

**Author:** ![gbrown](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gbrown/32/34482_2.png) [@gbrown](https://discuss.elastic.co/u/gbrown)\
**Post date:** [October 31, 2018, 6:52pm UTC](https://discuss.elastic.co/t/painless-qa-query/154883/2 "2018-10-31T18:52:54Z")

</div>

There are a few problems I see with your query.

1. You're using `ctx`, which isn't present in the Script Query context - you need to use `doc`.
2. You can't access `_source` from the Script Query context, only fields which have [doc\_values](https://www.elastic.co/guide/en/elasticsearch/reference/6.4/doc-values.html) enabled, and use need to use `doc.<field_name>.value` to access their value.
3. Your query uses a single equals (`=`), which is assignment in Painless. To check equality, you need to use a double equals (`==`).
4. In your example, `field_three` includes a space between the `foo` and `bar`, but the script does not add a space.

The query works when you change it like so (although note that I did shorten the field names):

```auto
GET testindex/_search
{
  "query": {
    "bool": {
      "must": {
        "script": {
          "script": {
            "source": "doc.three.value == doc.one.value + \" \" + doc.two.value"
          }
        }
      }
    }
  }
}

```

However, **this only works if `one`, `two`, and `three` are `keyword` fields in your mapping**. The values of the fields are only accessible in scripts if they are mapped as `keyword`, rather than as `text`. See the [doc\_values](https://www.elastic.co/guide/en/elasticsearch/reference/6.4/doc-values.html) documentation for more on that front.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 28, 2018, 6:52pm UTC](https://discuss.elastic.co/t/painless-qa-query/154883/3 "2018-11-28T18:52:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.