Children aggregation (1.4.0.Beta1) Round-Robin result

Elastic Stack Elasticsearch
3

Hi Martin,

The bucket key for parent-term aggregation is the same.

Maybe to make explanation simper, today I tried 2 queries:

Query A: Sum of the field "count" in child documents directly.

GET: INDEX-NAME/child/_search

{
"size": 0,
"query": {
"match_all": {}
},
"aggs": {
"requests": {
"sum": {
"field": "count"
}
}
}
}

Query B: Sum of the field "count" through parent documents.
GET: INDEX-NAME/_search ( we query all doc types here)

{
"size": 0,
"query": {
"match_all": {}
},
"aggs": {
"child": {
"children": {
"type": "child"
},
"aggs": {
"requests": {
"sum": {
"field": "count"
}
}
}
}
}
}

I expect these numbers to be about the same, but they are x times differs
from each other:

Result from query A:

"hits": {
"total": 4614829,
"max_score": 0,
"hits":
},
"aggregations": {
"requests": {
"value": 53364274 // numbers make sense
}
}

Result from query B:

"hits": {
"total": 4908110,
"max_score": 0,
"hits":
},
"aggregations": {
"child": {
"doc_count": 13267677,
"requests": {
"value": 11208150231 // numbers does not make any sense
}
}
}

I just want to understand whether it is the feature problem (parent-child
aggregation) or something wrong with data modeling.

Thank you

On Tuesday, October 21, 2014 10:03:07 AM UTC+2, Martijn v Groningen wrote:

Hi Vlad,

I see that the doc_count is also different between the requests. Is the
actual bucket key also different between A and B?

Martijn

On 21 October 2014 03:18, Vlad Vlaskin <vl...@admoment.ru <javascript:>>
wrote:

Dear ES group,
we've been using ES in production for a while and test eagerly all
new-coming features such as cardinality and others.

We try data modeling with parent-child relations (ES version 1.4.0.Beta1,
8 nodes, EC2 r3.xlarge, ssd, lot ram etc.)
With data model of:
Parent
{
"key": "value"
}

and a timeline with children, holding metrics:

Child (type "metrics")
{
"day": "2014-10-20",
"count: 10
}

We update metric documents and properly index them with script+upsert.
The problem is that the query below* yields in 2 different results in
round robin way. *
E.g. first time you call it you receive the first number, a second after
you receive the second and again back to the first, etc.

{
"size": 0,
"query": {
"match_all": {}
},
"aggs": {
"MY_FIELD": {
"terms": {
"field": "FIELD-XYZ" // parent term
aggregation
},
"aggs": {
"children": {
"children": {
"type": "metrics" // child aggregation of
type "metrics"
},
"aggs": {
"requests": {
"sum": {
"field": "count" // target aggregation
within child documents
}
}
}
}
}
}
}
}

Result A:
"aggregations": {
"MY_FIELD": {
"doc_count_error_upper_bound": 0,
"buckets": [
{
"key": "xx",
"doc_count": 283322,
"children": {
"doc_count": 3740372,
"requests": {
"value": 5801652297
}
}
}
]
}
}

Result B:
"aggregations": {
"MY_FIELD": {
"doc_count_error_upper_bound": 0,
"buckets": [
{
"key": "xx",
"doc_count": 302421,
"children": {
"doc_count": 1877361,
"requests": {
"value": 2965346170
}
}
}
]
}
}

The problem is that switching A to B back and forth is pretty stable
and reproducible.
ES logs are clear.

Could someone help towards some ideas here?

Thank you!

Vlad

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/6c948f61-0dce-4a62-b6ce-22b6a83aeaca%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/6c948f61-0dce-4a62-b6ce-22b6a83aeaca%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
Met vriendelijke groet,

Martijn van Groningen

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2280502d-1c92-4e2b-81f1-aa87c41d81ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.