.
> > To view this discussion on the web visit
> > [https://groups.google.com/d/msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%40googlegroups.com)
> > .
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
>
> --
> Met vriendelijke groet,
>
> Martijn van Groningen
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8bafbc47-a68f-41fa-8730-d17cf1832011%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8bafbc47-a68f-41fa-8730-d17cf1832011%40googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Jean\_Baptiste\_Lievre](https://discuss.elastic.co/u/Jean_Baptiste_Lievre)
#### Post date: [January 10, 2014, 4:53pm UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/4 "2014-01-10T16:53:24Z")
Going further on the subject, I have tried to work around the issue using a
filtered query, to no avail.
So basically, if I want to fetch all child document IDs that match a given
criterion on their parent, I have either to
- use a query - which in my case requires that I duplicate the existing
code that builds a filter, building a query instead
- or do it in 2 requests, one to count the totalHits matching the criteria,
the second using totalHits in the "size" parameter to fetch all IDs at once
Is there any other solution?
Le jeudi 9 janvier 2014 10:18:25 UTC+1, Jean-Baptiste Lièvremont a écrit :
> Hi Martijn,
>
> Thanks for your answer. You can find in the gist below some HTTP
> conversations made on my ES 0.90.6 node, as well as a link to the Java code
> responsible for the calls:
> [The attached files describe HTTP exchanges made with the REST API of an ElasticSearch 0.90.6 node, to describe the problem encountered in this thread: https://groups.google.com/forum/#!topic/elasticsearch/pfQ1wiTeObk The node has one index named 'rules' with 2 types ('rule' and 'active\_rule'). The Java code responsible for the calls can be found at: https://github.com/SonarSource/sonar/blob/master/sonar-server/src/main/java/org/sonar/server/rule/ProfileRules.java?source=cc#L116 · GitHub](https://gist.github.com/jblievremont/8331460)
>
> Please note that the issue appears only when combining scan/scroll with
> has\_parent filter, as it seems to work using a has\_parent query instead.
>
> Best regards,
> -- Jean-Baptiste Lièvremont
>
> Le jeudi 9 janvier 2014 00:18:14 UTC+1, Martijn v Groningen a écrit :
>
> > Hi Jean,
> >
> > Can you share how you execute the scan request with the has\_parent
> > filter? (via a gist or something like that)
> >
> > Martijn
> >
> > On 8 January 2014 15:17, Jean-Baptiste Lièvremont \<
> > [jean-baptist...@sonarsource.com](mailto:jean-baptist...@sonarsource.com)\> wrote:
> >
> > > Hi folks,
> > >
> > > I use a parent/child mapping configuration which works flawlessly with
> > > "classic" search requests, e.g using has\_parent to find child documents
> > > with criteria on the parent documents.
> > >
> > > I am trying to get all child document IDs that match a given set of
> > > criteria using scan and scroll, which also works well - until I introduce
> > > the has\_parent filter, in which case the scroll request returns no hit
> > > (although total\_hits is correct).
> > >
> > > Is it a known issue?
> > >
> > > I can provide sample mapping files and queries with associated/expected
> > > results. Please note that this behavior has been noticed on 0.90.6 but is
> > > still present in 0.90.9.
> > >
> > > Thanks, best regards,
> > > -- Jean-Baptiste Lièvremont
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> > > Groups "elasticsearch" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).
> > > To view this discussion on the web visit
> > > [https://groups.google.com/d/msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%40googlegroups.com)
> > > .
> > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> >
> > --
> > Met vriendelijke groet,
> >
> > Martijn van Groningen
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/374c3350-ca10-4699-9aae-b72087aba07a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/374c3350-ca10-4699-9aae-b72087aba07a%40googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@mvg](https://discuss.elastic.co/u/mvg)
#### Post date: [January 14, 2014, 10:23pm UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/5 "2014-01-14T22:23:04Z")
I'm a bit confused the first query with has\_parent doesn't return hits, but
the second does according to your gist or I'm I misreading it.
I just did a little test here and has\_parent and search with search\_type
scan seems to work correctly.
On 10 January 2014 17:53, Jean-Baptiste Lièvremont \<
[jean-baptiste.lievremont@sonarsource.com](mailto:jean-baptiste.lievremont@sonarsource.com)\> wrote:
> Going further on the subject, I have tried to work around the issue using
> a filtered query, to no avail.
>
> So basically, if I want to fetch all child document IDs that match a given
> criterion on their parent, I have either to
>
> - use a query - which in my case requires that I duplicate the existing
> code that builds a filter, building a query instead
> - or do it in 2 requests, one to count the totalHits matching the
> criteria, the second using totalHits in the "size" parameter to fetch all
> IDs at once
>
> Is there any other solution?
>
> Le jeudi 9 janvier 2014 10:18:25 UTC+1, Jean-Baptiste Lièvremont a écrit :
>
> > Hi Martijn,
> >
> > Thanks for your answer. You can find in the gist below some HTTP
> > conversations made on my ES 0.90.6 node, as well as a link to the Java code
> > responsible for the calls:
> > [The attached files describe HTTP exchanges made with the REST API of an ElasticSearch 0.90.6 node, to describe the problem encountered in this thread: https://groups.google.com/forum/#!topic/elasticsearch/pfQ1wiTeObk The node has one index named 'rules' with 2 types ('rule' and 'active\_rule'). The Java code responsible for the calls can be found at: https://github.com/SonarSource/sonar/blob/master/sonar-server/src/main/java/org/sonar/server/rule/ProfileRules.java?source=cc#L116 · GitHub](https://gist.github.com/jblievremont/8331460)
> >
> > Please note that the issue appears only when combining scan/scroll with
> > has\_parent filter, as it seems to work using a has\_parent query instead.
> >
> > Best regards,
> > -- Jean-Baptiste Lièvremont
> >
> > Le jeudi 9 janvier 2014 00:18:14 UTC+1, Martijn v Groningen a écrit :
> >
> > > Hi Jean,
> > >
> > > Can you share how you execute the scan request with the has\_parent
> > > filter? (via a gist or something like that)
> > >
> > > Martijn
> > >
> > > On 8 January 2014 15:17, Jean-Baptiste Lièvremont \<
> > > [jean-baptist...@sonarsource.com](mailto:jean-baptist...@sonarsource.com)\> wrote:
> > >
> > > > Hi folks,
> > > >
> > > > I use a parent/child mapping configuration which works flawlessly with
> > > > "classic" search requests, e.g using has\_parent to find child documents
> > > > with criteria on the parent documents.
> > > >
> > > > I am trying to get all child document IDs that match a given set of
> > > > criteria using scan and scroll, which also works well - until I introduce
> > > > the has\_parent filter, in which case the scroll request returns no hit
> > > > (although total\_hits is correct).
> > > >
> > > > Is it a known issue?
> > > >
> > > > I can provide sample mapping files and queries with associated/expected
> > > > results. Please note that this behavior has been noticed on 0.90.6 but is
> > > > still present in 0.90.9.
> > > >
> > > > Thanks, best regards,
> > > > -- Jean-Baptiste Lièvremont
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google
> > > > Groups "elasticsearch" group.
> > > > To unsubscribe from this group and stop receiving emails from it, send
> > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).
> > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)
> > > > msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%
> > > > [40googlegroups.com](http://40googlegroups.com).
> > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > >
> > > --
> > > Met vriendelijke groet,
> > >
> > > Martijn van Groningen
--
Met vriendelijke groet,
Martijn van Groningen
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TxNLAq6XMtC7oco%3D1bTOYYaRbedbfrJBrd7G7qCwcC\_Bg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TxNLAq6XMtC7oco%3D1bTOYYaRbedbfrJBrd7G7qCwcC_Bg%40mail.gmail.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@mvg](https://discuss.elastic.co/u/mvg)
#### Post date: [January 14, 2014, 10:28pm UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/6 "2014-01-14T22:28:53Z")
So this is related to:
>
>
> When using scroll with a has\_child filter, the initial request returns the corre…ct total number of hits, but subsequent requests return no hits.
>
> It looks like this problem was introduced in 0.90.6, and still occurs in 0.90.10. 0.90.5 works as expected.
>
> The number of documents seems to play a part - in my initial test cases with only 2 parent documents, I couldn't reproduce the issue. However, creating 100 parents does reliably reproduce it. In my testing, 8 parent documents worked fine, but 9 did not.
>
> It sounds very similar to the issue mentioned here: http://elasticsearch-users.115913.n3.nabble.com/No-hit-using-scan-scroll-with-has-parent-filter-td4047236.html
>
> Here's a test script (requires jq(1) to grab the scroll ID from the first JSON result):
>
> \`\`\` bash
> \#!/bin/sh
>
> HOST='localhost:9200'
> INDEX='test\_scroll\_jj'
> CURL="curl -q --ipv4 --silent --show-error --fail"
>
> $CURL -XDELETE "$HOST/${INDEX}?pretty=true" \>/dev/null
> $CURL -XPOST "$HOST/${INDEX}/?pretty=true" -d '
> {
> "mappings": {
> "homes":{
> "\_parent":{
> "type" : "person"
> }
> }
> }
> }' \>/dev/null
>
> for x in {1..100}; do # in my testing, 8 docs works, 9 fails
> $CURL -XPUT "$HOST/${INDEX}/person/$x/?pretty=true" -d '{}' \>/dev/null
> $CURL -XPOST "$HOST/${INDEX}/homes?parent=$x&pretty=true" -d '{}' \>/dev/null
> done
>
> $CURL -XPOST "$HOST/${INDEX}/\_refresh?pretty=true" \>/dev/null
>
> echo "REQUEST ONE:"
> SCROLL\_RESULT=$($CURL -v -XPOST "http://$HOST/${INDEX}/person/\_search?pretty=true&scroll=30s" -d'
> {
> "size" : 1,
> "fields" : \["\_id"\],
> "query" : {
> "filtered" : {
> "filter" : {
> "has\_child" : {
> "type" : "homes",
> "query" : {
> "match\_all" : {}
> }
> }
> }
> }
> }
> }')
> echo $SCROLL\_RESULT
>
> scroll\_id=$(echo $SCROLL\_RESULT | jq -r '.\["\_scroll\_id"\]')
>
> echo
> echo "REQUEST TWO:"
> $CURL -v "http://$HOST/\_search/scroll?scroll=30s&scroll\_id=$scroll\_id&pretty=true"
> \`\`\`
>
> The failing output on 0.90.10:
>
> \`\`\`
> /tmp|⇒ /tmp/scrollbug.sh
> REQUEST ONE:
> \* About to connect() to localhost port 9200 (#0)
> \* Trying 127.0.0.1...
> \* Adding handle: conn: 0x7fb832006e00
> \* Adding handle: send: 0
> \* Adding handle: recv: 0
> \* Curl\_addHandleToPipeline: length: 1
> \* - Conn 0 (0x7fb832006e00) send\_pipe: 1, recv\_pipe: 0
> \* Connected to localhost (127.0.0.1) port 9200 (#0)
> \> POST /test\_scroll\_jj/person/\_search?pretty=true&scroll=30s HTTP/1.1
> \> User-Agent: curl/7.32.0
> \> Host: localhost:9200
> \> Accept: \*/\*
> \> Content-Length: 321
> \> Content-Type: application/x-www-form-urlencoded
> \>
> } \[data not shown\]
> \* upload completely sent off: 321 out of 321 bytes
> \< HTTP/1.1 200 OK
> \< Content-Type: application/json; charset=UTF-8
> \< Content-Length: 520
> \<
> { \[data not shown\]
> \* Connection #0 to host localhost left intact
> { "\_scroll\_id" : "cXVlcnlUaGVuRmV0Y2g7NTs2OkM5SXlBenNyU0lXR21uX3JsN25XcHc7NzpDOUl5QXpzclNJV0dtbl9ybDduV3B3Ozg6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzs5OkM5SXlBenNyU0lXR21uX3JsN25XcHc7MTA6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzswOw==", "took" : 5, "timed\_out" : false, "\_shards" : { "total" : 5, "successful" : 5, "failed" : 0 }, "hits" : { "total" : 100, "max\_score" : 1.0, "hits" : \[{ "\_index" : "test\_scroll\_jj", "\_type" : "person", "\_id" : "2", "\_score" : 1.0 } \] } }
>
> REQUEST TWO:
> \* About to connect() to localhost port 9200 (#0)
> \* Trying 127.0.0.1...
> \* Adding handle: conn: 0x7f8589806e00
> \* Adding handle: send: 0
> \* Adding handle: recv: 0
> \* Curl\_addHandleToPipeline: length: 1
> \* - Conn 0 (0x7f8589806e00) send\_pipe: 1, recv\_pipe: 0
> \* Connected to localhost (127.0.0.1) port 9200 (#0)
> \> GET /\_search/scroll?scroll=30s&scroll\_id=cXVlcnlUaGVuRmV0Y2g7NTs2OkM5SXlBenNyU0lXR21uX3JsN25XcHc7NzpDOUl5QXpzclNJV0dtbl9ybDduV3B3Ozg6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzs5OkM5SXlBenNyU0lXR21uX3JsN25XcHc7MTA6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzswOw==&pretty=true HTTP/1.1
> \> User-Agent: curl/7.32.0
> \> Host: localhost:9200
> \> Accept: \*/\*
> \>
> \< HTTP/1.1 200 OK
> \< Content-Type: application/json; charset=UTF-8
> \< Content-Length: 410
> \<
> {
> "\_scroll\_id" : "cXVlcnlUaGVuRmV0Y2g7NTs2OkM5SXlBenNyU0lXR21uX3JsN25XcHc7NzpDOUl5QXpzclNJV0dtbl9ybDduV3B3Ozg6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzs5OkM5SXlBenNyU0lXR21uX3JsN25XcHc7MTA6QzlJeUF6c3JTSVdHbW5fcmw3bldwdzswOw==",
> "took" : 0,
> "timed\_out" : false,
> "\_shards" : {
> "total" : 5,
> "successful" : 5,
> "failed" : 0
> },
> "hits" : {
> "total" : 0,
> "max\_score" : null,
> "hits" : \[\]
> }
> }
> \`\`\`
>
> And the expected output as per 0.90.5:
>
> \`\`\`
> /tmp|⇒ /tmp/scrollbug.sh
> REQUEST ONE:
> \* About to connect() to localhost port 9200 (#0)
> \* Trying 127.0.0.1...
> \* Adding handle: conn: 0x7fd04a006e00
> \* Adding handle: send: 0
> \* Adding handle: recv: 0
> \* Curl\_addHandleToPipeline: length: 1
> \* - Conn 0 (0x7fd04a006e00) send\_pipe: 1, recv\_pipe: 0
> \* Connected to localhost (127.0.0.1) port 9200 (#0)
> \> POST /test\_scroll\_jj/person/\_search?pretty=true&scroll=30s HTTP/1.1
> \> User-Agent: curl/7.32.0
> \> Host: localhost:9200
> \> Accept: \*/\*
> \> Content-Length: 321
> \> Content-Type: application/x-www-form-urlencoded
> \>
> } \[data not shown\]
> \* upload completely sent off: 321 out of 321 bytes
> \< HTTP/1.1 200 OK
> \< Content-Type: application/json; charset=UTF-8
> \< Content-Length: 523
> \<
> { \[data not shown\]
> \* Connection #0 to host localhost left intact
> { "\_scroll\_id" : "cXVlcnlUaGVuRmV0Y2g7NTsyMTpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzIzOkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MjI6SC1fSFFlNjJUa1M0MndiUWM2S0t3UTsyNDpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzI1OkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MDs=", "took" : 9, "timed\_out" : false, "\_shards" : { "total" : 5, "successful" : 5, "failed" : 0 }, "hits" : { "total" : 100, "max\_score" : 1.0, "hits" : \[{ "\_index" : "test\_scroll\_jj", "\_type" : "person", "\_id" : "2", "\_score" : 1.0 } \] } }
>
> REQUEST TWO:
> \* About to connect() to localhost port 9200 (#0)
> \* Trying 127.0.0.1...
> \* Adding handle: conn: 0x7f8a92006e00
> \* Adding handle: send: 0
> \* Adding handle: recv: 0
> \* Curl\_addHandleToPipeline: length: 1
> \* - Conn 0 (0x7f8a92006e00) send\_pipe: 1, recv\_pipe: 0
> \* Connected to localhost (127.0.0.1) port 9200 (#0)
> \> GET /\_search/scroll?scroll=30s&scroll\_id=cXVlcnlUaGVuRmV0Y2g7NTsyMTpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzIzOkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MjI6SC1fSFFlNjJUa1M0MndiUWM2S0t3UTsyNDpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzI1OkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MDs=&pretty=true HTTP/1.1
> \> User-Agent: curl/7.32.0
> \> Host: localhost:9200
> \> Accept: \*/\*
> \>
> \< HTTP/1.1 200 OK
> \< Content-Type: application/json; charset=UTF-8
> \< Content-Length: 523
> \<
> {
> "\_scroll\_id" : "cXVlcnlUaGVuRmV0Y2g7NTsyMTpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzIzOkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MjI6SC1fSFFlNjJUa1M0MndiUWM2S0t3UTsyNDpILV9IUWU2MlRrUzQyd2JRYzZLS3dROzI1OkgtX0hRZTYyVGtTNDJ3YlFjNktLd1E7MDs=",
> "took" : 2,
> "timed\_out" : false,
> "\_shards" : {
> "total" : 5,
> "successful" : 5,
> "failed" : 0
> },
> "hits" : {
> "total" : 100,
> "max\_score" : 1.0,
> "hits" : \[ {
> "\_index" : "test\_scroll\_jj",
> "\_type" : "person",
> "\_id" : "7",
> "\_score" : 1.0
> } \]
> }
> }
> \`\`\`
On 14 January 2014 23:23, Martijn v Groningen \<[martijn.v.groningen@gmail.com](mailto:martijn.v.groningen@gmail.com)
> wrote:
> I'm a bit confused the first query with has\_parent doesn't return hits,
> but the second does according to your gist or I'm I misreading it.
>
> I just did a little test here and has\_parent and search with search\_type
> scan seems to work correctly.
>
> On 10 January 2014 17:53, Jean-Baptiste Lièvremont \<
> [jean-baptiste.lievremont@sonarsource.com](mailto:jean-baptiste.lievremont@sonarsource.com)\> wrote:
>
> > Going further on the subject, I have tried to work around the issue using
> > a filtered query, to no avail.
> >
> > So basically, if I want to fetch all child document IDs that match a
> > given criterion on their parent, I have either to
> >
> > - use a query - which in my case requires that I duplicate the existing
> > code that builds a filter, building a query instead
> > - or do it in 2 requests, one to count the totalHits matching the
> > criteria, the second using totalHits in the "size" parameter to fetch all
> > IDs at once
> >
> > Is there any other solution?
> >
> > Le jeudi 9 janvier 2014 10:18:25 UTC+1, Jean-Baptiste Lièvremont a écrit :
> >
> > > Hi Martijn,
> > >
> > > Thanks for your answer. You can find in the gist below some HTTP
> > > conversations made on my ES 0.90.6 node, as well as a link to the Java code
> > > responsible for the calls:
> > > [The attached files describe HTTP exchanges made with the REST API of an ElasticSearch 0.90.6 node, to describe the problem encountered in this thread: https://groups.google.com/forum/#!topic/elasticsearch/pfQ1wiTeObk The node has one index named 'rules' with 2 types ('rule' and 'active\_rule'). The Java code responsible for the calls can be found at: https://github.com/SonarSource/sonar/blob/master/sonar-server/src/main/java/org/sonar/server/rule/ProfileRules.java?source=cc#L116 · GitHub](https://gist.github.com/jblievremont/8331460)
> > >
> > > Please note that the issue appears only when combining scan/scroll with
> > > has\_parent filter, as it seems to work using a has\_parent query instead.
> > >
> > > Best regards,
> > > -- Jean-Baptiste Lièvremont
> > >
> > > Le jeudi 9 janvier 2014 00:18:14 UTC+1, Martijn v Groningen a écrit :
> > >
> > > > Hi Jean,
> > > >
> > > > Can you share how you execute the scan request with the has\_parent
> > > > filter? (via a gist or something like that)
> > > >
> > > > Martijn
> > > >
> > > > On 8 January 2014 15:17, Jean-Baptiste Lièvremont \<
> > > > [jean-baptist...@sonarsource.com](mailto:jean-baptist...@sonarsource.com)\> wrote:
> > > >
> > > > > Hi folks,
> > > > >
> > > > > I use a parent/child mapping configuration which works flawlessly with
> > > > > "classic" search requests, e.g using has\_parent to find child documents
> > > > > with criteria on the parent documents.
> > > > >
> > > > > I am trying to get all child document IDs that match a given set of
> > > > > criteria using scan and scroll, which also works well - until I introduce
> > > > > the has\_parent filter, in which case the scroll request returns no hit
> > > > > (although total\_hits is correct).
> > > > >
> > > > > Is it a known issue?
> > > > >
> > > > > I can provide sample mapping files and queries with
> > > > > associated/expected results. Please note that this behavior has been
> > > > > noticed on 0.90.6 but is still present in 0.90.9.
> > > > >
> > > > > Thanks, best regards,
> > > > > -- Jean-Baptiste Lièvremont
> > > > >
> > > > > --
> > > > > You received this message because you are subscribed to the Google
> > > > > Groups "elasticsearch" group.
> > > > > To unsubscribe from this group and stop receiving emails from it, send
> > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).
> > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)
> > > > > msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%
> > > > > [40googlegroups.com](http://40googlegroups.com).
> > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > > >
> > > > --
> > > > Met vriendelijke groet,
> > > >
> > > > Martijn van Groningen
>
> --
> Met vriendelijke groet,
>
> Martijn van Groningen
--
Met vriendelijke groet,
Martijn van Groningen
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TwQ64N1TyPZBxZE8ugWKa6b%2B5BPuJ8FqeK86zHsHtavFQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TwQ64N1TyPZBxZE8ugWKa6b%2B5BPuJ8FqeK86zHsHtavFQ%40mail.gmail.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Jean\_Baptiste\_Lievre](https://discuss.elastic.co/u/Jean_Baptiste_Lievre)
#### Post date: [January 15, 2014, 8:17am UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/7 "2014-01-15T08:17:11Z")
Yep, this seems definitely related to the linked issue. I am looking
forward to testing your fix, hopefully in 0.90.11 🙂
Regards,
-- JB.L
2014/1/14 Martijn v Groningen [martijn.v.groningen@gmail.com](mailto:martijn.v.groningen@gmail.com)
> So this is related to:
> [Scrolling with has\_child filter returns no hits on 2nd request · Issue #4703 · elastic/elasticsearch · GitHub](https://github.com/elasticsearch/elasticsearch/issues/4703)
>
> On 14 January 2014 23:23, Martijn v Groningen \<
> [martijn.v.groningen@gmail.com](mailto:martijn.v.groningen@gmail.com)\> wrote:
>
> > I'm a bit confused the first query with has\_parent doesn't return hits,
> > but the second does according to your gist or I'm I misreading it.
> >
> > I just did a little test here and has\_parent and search with search\_type
> > scan seems to work correctly.
> >
> > On 10 January 2014 17:53, Jean-Baptiste Lièvremont \<
> > [jean-baptiste.lievremont@sonarsource.com](mailto:jean-baptiste.lievremont@sonarsource.com)\> wrote:
> >
> > > Going further on the subject, I have tried to work around the issue
> > > using a filtered query, to no avail.
> > >
> > > So basically, if I want to fetch all child document IDs that match a
> > > given criterion on their parent, I have either to
> > >
> > > - use a query - which in my case requires that I duplicate the existing
> > > code that builds a filter, building a query instead
> > > - or do it in 2 requests, one to count the totalHits matching the
> > > criteria, the second using totalHits in the "size" parameter to fetch all
> > > IDs at once
> > >
> > > Is there any other solution?
> > >
> > > Le jeudi 9 janvier 2014 10:18:25 UTC+1, Jean-Baptiste Lièvremont a
> > > écrit :
> > >
> > > > Hi Martijn,
> > > >
> > > > Thanks for your answer. You can find in the gist below some HTTP
> > > > conversations made on my ES 0.90.6 node, as well as a link to the Java code
> > > > responsible for the calls:
> > > > [The attached files describe HTTP exchanges made with the REST API of an ElasticSearch 0.90.6 node, to describe the problem encountered in this thread: https://groups.google.com/forum/#!topic/elasticsearch/pfQ1wiTeObk The node has one index named 'rules' with 2 types ('rule' and 'active\_rule'). The Java code responsible for the calls can be found at: https://github.com/SonarSource/sonar/blob/master/sonar-server/src/main/java/org/sonar/server/rule/ProfileRules.java?source=cc#L116 · GitHub](https://gist.github.com/jblievremont/8331460)
> > > >
> > > > Please note that the issue appears only when combining scan/scroll with
> > > > has\_parent filter, as it seems to work using a has\_parent query instead.
> > > >
> > > > Best regards,
> > > > -- Jean-Baptiste Lièvremont
> > > >
> > > > Le jeudi 9 janvier 2014 00:18:14 UTC+1, Martijn v Groningen a écrit :
> > > >
> > > > > Hi Jean,
> > > > >
> > > > > Can you share how you execute the scan request with the has\_parent
> > > > > filter? (via a gist or something like that)
> > > > >
> > > > > Martijn
> > > > >
> > > > > On 8 January 2014 15:17, Jean-Baptiste Lièvremont \<
> > > > > [jean-baptist...@sonarsource.com](mailto:jean-baptist...@sonarsource.com)\> wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I use a parent/child mapping configuration which works flawlessly
> > > > > > with "classic" search requests, e.g using has\_parent to find child
> > > > > > documents with criteria on the parent documents.
> > > > > >
> > > > > > I am trying to get all child document IDs that match a given set of
> > > > > > criteria using scan and scroll, which also works well - until I introduce
> > > > > > the has\_parent filter, in which case the scroll request returns no hit
> > > > > > (although total\_hits is correct).
> > > > > >
> > > > > > Is it a known issue?
> > > > > >
> > > > > > I can provide sample mapping files and queries with
> > > > > > associated/expected results. Please note that this behavior has been
> > > > > > noticed on 0.90.6 but is still present in 0.90.9.
> > > > > >
> > > > > > Thanks, best regards,
> > > > > > -- Jean-Baptiste Lièvremont
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the Google
> > > > > > Groups "elasticsearch" group.
> > > > > > To unsubscribe from this group and stop receiving emails from it,
> > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).
> > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)
> > > > > > msgid/elasticsearch/fd7c563e-34f7-4aa8-ab1a-460840ba2af0%
> > > > > > [40googlegroups.com](http://40googlegroups.com).
> > > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > > > >
> > > > > --
> > > > > Met vriendelijke groet,
> > > > >
> > > > > Martijn van Groningen
> >
> > --
> > Met vriendelijke groet,
> >
> > Martijn van Groningen
>
> --
> Met vriendelijke groet,
>
> Martijn van Groningen
--
\*Jean-Baptiste LIEVREMONT | \*
\*SonarSource \*_Core Developer_
> **[Clean Code Tools for Writing Clear, Readable & Understandable Secure...](https://www.sonarsource.com/)**
>
> Sonar’s industry leading solution enables developers & development teams to write clean code and remediate existing code organically.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANYhQu1Envd-ijshBn6KRKXBt7gPft%2BbxrzA-XcYOJMksnRDmQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANYhQu1Envd-ijshBn6KRKXBt7gPft%2BbxrzA-XcYOJMksnRDmQ%40mail.gmail.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@mvg](https://discuss.elastic.co/u/mvg)
#### Post date: [January 15, 2014, 9:32am UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/8 "2014-01-15T09:32:38Z")
Thanks 🙂 The work around for now is I guess to use the has\_parent query
instead of the has\_parent filter.
On 15 January 2014 09:17, Jean-Baptiste Lièvremont \<
[jean-baptiste.lievremont@sonarsource.com](mailto:jean-baptiste.lievremont@sonarsource.com)\> wrote:
> Yep, this seems definitely related to the linked issue. I am looking
> forward to testing your fix, hopefully in 0.90.11 🙂
>
> Regards,
> -- JB.L
>
> 2014/1/14 Martijn v Groningen [martijn.v.groningen@gmail.com](mailto:martijn.v.groningen@gmail.com)
>
> > So this is related to:
> > [Scrolling with has\_child filter returns no hits on 2nd request · Issue #4703 · elastic/elasticsearch · GitHub](https://github.com/elasticsearch/elasticsearch/issues/4703)
> >
> > On 14 January 2014 23:23, Martijn v Groningen \<
> > [martijn.v.groningen@gmail.com](mailto:martijn.v.groningen@gmail.com)\> wrote:
> >
> > > I'm a bit confused the first query with has\_parent doesn't return hits,
> > > but the second does according to your gist or I'm I misreading it.
> > >
> > > I just did a little test here and has\_parent and search with search\_type
> > > scan seems to work correctly.
> > >
> > > On 10 January 2014 17:53, Jean-Baptiste Lièvremont \<
> > > [jean-baptiste.lievremont@sonarsource.com](mailto:jean-baptiste.lievremont@sonarsource.com)\> wrote:
> > >
> > > > Going further on the subject, I have tried to work around the issue
> > > > using a filtered query, to no avail.
> > > >
> > > > So basically, if I want to fetch all child document IDs that match a
> > > > given criterion on their parent, I have either to
> > > >
> > > > - use a query - which in my case requires that I duplicate the existing
> > > > code that builds a filter, building a query instead
> > > > - or do it in 2 requests, one to count the totalHits matching the
> > > > criteria, the second using totalHits in the "size" parameter to fetch all
> > > > IDs at once
> > > >
> > > > Is there any other solution?
> > > >
> > > > Le jeudi 9 janvier 2014 10:18:25 UTC+1, Jean-Baptiste Lièvremont a
> > > > écrit :
> > > >
> > > > > Hi Martijn,
> > > > >
> > > > > Thanks for your answer. You can find in the gist below some HTTP
> > > > > conversations made on my ES 0.90.6 node, as well as a link to the Java code
> > > > > responsible for the calls:
> > > > > [The attached files describe HTTP exchanges made with the REST API of an ElasticSearch 0.90.6 node, to describe the problem encountered in this thread: https://groups.google.com/forum/#!topic/elasticsearch/pfQ1wiTeObk The node has one index named 'rules' with 2 types ('rule' and 'active\_rule'). The Java code responsible for the calls can be found at: https://github.com/SonarSource/sonar/blob/master/sonar-server/src/main/java/org/sonar/server/rule/ProfileRules.java?source=cc#L116 · GitHub](https://gist.github.com/jblievremont/8331460)
> > > > >
> > > > > Please note that the issue appears only when combining scan/scroll
> > > > > with has\_parent filter, as it seems to work using a has\_parent query
> > > > > instead.
> > > > >
> > > > > Best regards,
> > > > > -- Jean-Baptiste Lièvremont
> > > > >
> > > > > Le jeudi 9 janvier 2014 00:18:14 UTC+1, Martijn v Groningen a écrit :
> > > > >
> > > > > > Hi Jean,
> > > > > >
> > > > > > Can you share how you execute the scan request with the has\_parent
> > > > > > filter? (via a gist or something like that)
> > > > > >
> > > > > > Martijn
> > > > > >
> > > > > > On 8 January 2014 15:17, Jean-Baptiste Lièvremont \<
> > > > > > [jean-baptist...@sonarsource.com](mailto:jean-baptist...@sonarsource.com)\> wrote:
> > > > > >
> > > > > > > Hi folks,
> > > > > > >
> > > > > > > I use a parent/child mapping configuration which works flawlessly
> > > > > > > with "classic" search requests, e.g using has\_parent to find child
> > > > > > > documents with criteria on the parent documents.
> > > > > > >
> > > > > > > I am trying to get all child document IDs that match a given set of
> > > > > > > criteria using scan and scroll, which also works well - until I introduce
> > > > > > > the has\_parent filter, in which case the scroll request returns no hit
> > > > > > > (although total\_hits is correct).
> > > > > > >
> > > > > > > Is it a known issue?
> > > > > > >
> > > > > > > I can provide sample mapping files and queries with
> > > > > > > associated/expected results. Please note that this behavior has been
> > > > > > > noticed on 0.90.6 but is still present in 0.90.9.
> > > > > > >
> > > > > > > Thanks, best regards,
> > > > > > > -- Jean-Baptiste Lièvremont
> > > > > > >
> > > > > > > --
> > > > > > > You received this message because you are subscribed to the Google
> > > > > > > Groups "elasticsearch" group.
> > > > > > > To unsubscribe from this group and stop receiving emails from it,
> > > > > > > send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).
> > > > > > > To view this discussion on the web visit
> > > > > > > [https://groups.google.com/d/msgid/elasticsearch/fd7c563e-](https://groups.google.com/d/msgid/elasticsearch/fd7c563e-)
> > > > > > > 34f7-4aa8-ab1a-460840ba2af0%[40googlegroups.com](http://40googlegroups.com).
> > > > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > > > > >
> > > > > > --
> > > > > > Met vriendelijke groet,
> > > > > >
> > > > > > Martijn van Groningen
> > >
> > > --
> > > Met vriendelijke groet,
> > >
> > > Martijn van Groningen
> >
> > --
> > Met vriendelijke groet,
> >
> > Martijn van Groningen
>
> --
> \*Jean-Baptiste LIEVREMONT | \*
> \*SonarSource \*_Core Developer_
> [http://sonarsource.com](http://sonarsource.com)
--
Met vriendelijke groet,
Martijn van Groningen
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TwyZ-GdXRTygNPx6nrm%3D0ARh2Xj%2B08FskKabCc\_GwUjHA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2BA76TwyZ-GdXRTygNPx6nrm%3D0ARh2Xj%2B08FskKabCc_GwUjHA%40mail.gmail.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:56am UTC](https://discuss.elastic.co/t/no-hit-using-scan-scroll-with-has-parent-filter/15143/9 "2017-07-06T01:56:44Z")