# Intermittent scoring returned
**URL:** https://discuss.elastic.co/t/intermittent-scoring-returned/16784
**Category:** Elasticsearch
**Created:** [April 3, 2014, 11:01am UTC](https://discuss.elastic.co/t/intermittent-scoring-returned/16784 "2014-04-03T11:01:57Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@cyrilforce](https://discuss.elastic.co/u/cyrilforce)
#### Post date: [April 3, 2014, 11:01am UTC](https://discuss.elastic.co/t/intermittent-scoring-returned/16784/1 "2014-04-03T11:01:57Z")
Hi all,
I have encountered a weird behaviour. I trying to execute same query twice
and it returns me different scoring of same document.
This is affecting the order of the result returned as what i need is sort
by relevancy.
\*The query : \*
{
"from" : 0,
"size" : 100,
"explain" : true,
"query" : {
"filtered" : {
"query" : {
"multi\_match": {
"query": "happy",
"fields": ["DISPLAY\_NAME^6"]
}
},
"filter" : {
"query" : {
"bool" : {
"must" : {
"term" : {
"CHANNEL\_ID" : "1"
}
}
}
}
}
}
}
}
\*Result on first run : \*
"\_shard": 2,
"\_node": "h3g1u4jzT1KdJXDQF06qyA",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "_15939_",
"\_score": _10.882705_,
"\_source": {
"DISPLAY\_NAME": "_Happy_",
"PRICE": 1.5,
"AUDIO":
"[http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3](http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3)",
"CHANNEL\_ID": 1,
"CAT\_PARENT": 557,
"MEDIA\_ID": 15939,
"GENRE": "Happy",
"MEDIA\_PKEY": "540152",
"COMPOSER": null,
"PLAYER": null,
"CATMEDIA\_NAME": "Happy",
"FTID": null,
"VIEW\_ID": 241,
"POSITION": 6162,
"ITEMCODE": "147237",
"CAT\_ID": 558,
"PRIORITY": 100,
"CKEY": 533868,
"CATMEDIA\_RANK": 3,
"BILLINGTYPE\_ID": 1,
"CAT\_NAME": "POP",
"KEYWORDS": null,
"LONG\_DESCRIPTION": null,
"SHORT\_DESCRIPTION": null,
"TYPE\_ID": 76,
"ARTIST\_GENDER": null,
"PERFORMER": "Diandra Arjunaidi",
"MAPPINGS": "1\_241\_558\_POP\_557\_6162\_1.5",
"SHORTCODE": "0401119513",
"CATMEDIA\_CDATE": "2014-01-26T20:04:11.000Z",
"LANG\_ID": 1
},
"\_explanation": {
"value": 10.882705,
"description": "weight(DISPLAY\_NAME:happy in 853)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.882705,
"description": "fieldWeight in 853, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.882705,
"description": "idf(docFreq=63,
maxDocs=1253673)"
},
{
"value": 1,
"description": "fieldNorm(doc=853)"
}
]
}
]
}
\*Result on second run : \*
"\_shard": 2,
"\_node": "UOjX2lxhR6mzfjHHmTm3cQ",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "_15939_",
"\_score": _10.388683_,
"\_source": {
"DISPLAY\_NAME": "_Happy_",
"PRICE": 1.5,
"AUDIO":
"[http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3](http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3)",
"CHANNEL\_ID": 1,
"CAT\_PARENT": 557,
"MEDIA\_ID": 15939,
"GENRE": "Happy",
"MEDIA\_PKEY": "540152",
"COMPOSER": null,
"PLAYER": null,
"CATMEDIA\_NAME": "Happy",
"FTID": null,
"VIEW\_ID": 241,
"POSITION": 6162,
"ITEMCODE": "147237",
"CAT\_ID": 558,
"PRIORITY": 100,
"CKEY": 533868,
"CATMEDIA\_RANK": 3,
"BILLINGTYPE\_ID": 1,
"CAT\_NAME": "POP",
"KEYWORDS": null,
"LONG\_DESCRIPTION": null,
"SHORT\_DESCRIPTION": null,
"TYPE\_ID": 76,
"ARTIST\_GENDER": null,
"PERFORMER": "Diandra Arjunaidi",
"MAPPINGS": "1\_241\_558\_POP\_557\_6162\_1.5",
"SHORTCODE": "0401119513",
"CATMEDIA\_CDATE": "2014-01-26T20:04:11.000Z",
"LANG\_ID": 1
},
"\_explanation": {
"value": 10.388683,
"description": "weight(DISPLAY\_NAME:happy in 12392)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.388683,
"description": "fieldWeight in 12392, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.388683,
"description": "idf(docFreq=107,
maxDocs=1290854)"
},
{
"value": 1,
"description": "fieldNorm(doc=12392)"
}
]
}
]
}
_The mapping :_
{
"media": {
"properties": {
"AUDIO": {
"type": "string"
},
"BILLINGTYPE\_ID": {
"type": "long"
},
"CATMEDIA\_CDATE": {
"type": "date",
"format": "dateOptionalTime"
},
"CATMEDIA\_NAME": {
"type": "string"
},
"CATMEDIA\_RANK": {
"type": "long"
},
"CAT\_ID": {
"type": "long"
},
"CAT\_NAME": {
"type": "string",
"analyzer": "string\_lowercase",
"include\_in\_all": true
},
"CAT\_PARENT": {
"type": "long"
},
"CHANNEL\_ID": {
"type": "long"
},
"CKEY": {
"type": "long"
},
"_DISPLAY\_NAME_": {
"type": "string"
},
"FTID": {
"type": "string"
},
"GENRE": {
"type": "string"
},
"ITEMCODE": {
"type": "string"
},
"KEYWORDS": {
"type": "string"
},
"LANG\_ID": {
"type": "long"
},
"LONG\_DESCRIPTION": {
"type": "string"
},
"MAPPINGS": {
"type": "string",
"analyzer": "string\_lowercase",
"include\_in\_all": true
},
"MEDIA\_ID": {
"type": "long"
},
"MEDIA\_PKEY": {
"type": "string"
},
"PERFORMER": {
"type": "string"
},
"PLAYER": {
"type": "string"
},
"POSITION": {
"type": "long"
},
"PRICE": {
"type": "double"
},
"PRIORITY": {
"type": "long"
},
"SHORTCODE": {
"type": "string"
},
"SHORT\_DESCRIPTION": {
"type": "string"
},
"TYPE\_ID": {
"type": "long"
},
"VIEW\_ID": {
"type": "long"
}
}
}
}
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@cyrilforce](https://discuss.elastic.co/u/cyrilforce)
#### Post date: [April 3, 2014, 11:55am UTC](https://discuss.elastic.co/t/intermittent-scoring-returned/16784/2 "2014-04-03T11:55:37Z")
It seems like the first query is searching from the primary shard while the
the second time query is searching from secondary/replica shard.
\*result from 1st query : \*
"\_shard": 1,
"\_node": "VYQt633MTUuJdAwL--PE3A",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "380473",
"\_source": {
"DISPLAY\_NAME": "Be Happy",
.......
"\_explanation": {
"value": 10.873312,
"description": "weight(DISPLAY\_NAME:happy in 1517)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.873312,
"description": "fieldWeight in 1517, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.873312,
"description": "idf(docFreq=63,
maxDocs=1241952)"
},
{
"value": 1,
"description": "fieldNorm(doc=1517)"
}
]
}
]
}
"\_shard": 2,
"\_node": "UOjX2lxhR6mzfjHHmTm3cQ",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "15939",
"\_score": 10.388683,
"\_source": {
"DISPLAY\_NAME": "Happy",
.....
"\_explanation": {
"value": 10.388683,
"description": "weight(DISPLAY\_NAME:happy in 12392)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.388683,
"description": "fieldWeight in 12392, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.388683,
"description": "idf(docFreq=107,
maxDocs=1290854)"
},
{
"value": 1,
"description": "fieldNorm(doc=12392)"
}
]
}
]
}
* * *
\*result from second query : \*
"\_shard": 2,
"\_node": "h3g1u4jzT1KdJXDQF06qyA",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "15939",
"\_score": 10.882705,
"\_source": {
"DISPLAY\_NAME": "Happy",
.........
"\_explanation": {
"value": 10.882705,
"description": "weight(DISPLAY\_NAME:happy in 853)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.882705,
"description": "fieldWeight in 853, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.882705,
"description": "idf(docFreq=63,
maxDocs=1253673)"
},
{
"value": 1,
"description": "fieldNorm(doc=853)"
}
]
}
]
}
}
"\_shard": 1,
"\_node": "kr37FCksStOKW5ZCo6PCwQ",
"\_index": "jdbc\_dev",
"\_type": "media",
"\_id": "380473",
"\_score": 10.222518,
"\_source": {
"DISPLAY\_NAME": "Be Happy",
.........
"\_explanation": {
"value": 10.222518,
"description": "weight(DISPLAY\_NAME:happy in 3804)
[PerFieldSimilarity], result of:",
"details": [
{
"value": 10.222518,
"description": "fieldWeight in 3804, product
of:",
"details": [
{
"value": 1,
"description": "tf(freq=1.0), with freq
of:",
"details": [
{
"value": 1,
"description": "termFreq=1.0"
}
]
},
{
"value": 10.222518,
"description": "idf(docFreq=123,
maxDocs=1255192)"
},
{
"value": 1,
"description": "fieldNorm(doc=3804)"
}
]
}
]
}
}
Now the question is why different shard influence the scoring/relevancy so
much until that it swap the order eventhough i am using the same query
string and the document return is the same document but resides in
different shards. Is there anyway to disable searching from primary or
secondary/replica shard ?
Also why the first query return "_be happy_" instead of "_happy_" as i
didn't disable the "_norm_"
On Thu, Apr 3, 2014 at 7:01 PM, cyrilforce [cheehoo84@gmail.com](mailto:cheehoo84@gmail.com) wrote:
> Hi all,
>
> I have encountered a weird behaviour. I trying to execute same query twice
> and it returns me different scoring of same document.
> This is affecting the order of the result returned as what i need is sort
> by relevancy.
>
> \*The query : \*
> {
> "from" : 0,
> "size" : 100,
> "explain" : true,
> "query" : {
> "filtered" : {
> "query" : {
> "multi\_match": {
> "query": "happy",
> "fields": ["DISPLAY\_NAME^6"]
> }
> },
> "filter" : {
> "query" : {
> "bool" : {
> "must" : {
> "term" : {
> "CHANNEL\_ID" : "1"
> }
> }
> }
> }
> }
> }
> }
> }
>
> \*Result on first run : \*
> "\_shard": 2,
> "\_node": "h3g1u4jzT1KdJXDQF06qyA",
> "\_index": "jdbc\_dev",
> "\_type": "media",
> "\_id": "_15939_",
> "\_score": _10.882705_,
> "\_source": {
> "DISPLAY\_NAME": "_Happy_",
> "PRICE": 1.5,
> "AUDIO": "
> [http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3](http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3)",
> "CHANNEL\_ID": 1,
> "CAT\_PARENT": 557,
> "MEDIA\_ID": 15939,
> "GENRE": "Happy",
> "MEDIA\_PKEY": "540152",
> "COMPOSER": null,
> "PLAYER": null,
> "CATMEDIA\_NAME": "Happy",
> "FTID": null,
> "VIEW\_ID": 241,
> "POSITION": 6162,
> "ITEMCODE": "147237",
> "CAT\_ID": 558,
> "PRIORITY": 100,
> "CKEY": 533868,
> "CATMEDIA\_RANK": 3,
> "BILLINGTYPE\_ID": 1,
> "CAT\_NAME": "POP",
> "KEYWORDS": null,
> "LONG\_DESCRIPTION": null,
> "SHORT\_DESCRIPTION": null,
> "TYPE\_ID": 76,
> "ARTIST\_GENDER": null,
> "PERFORMER": "Diandra Arjunaidi",
> "MAPPINGS": "1\_241\_558\_POP\_557\_6162\_1.5",
> "SHORTCODE": "0401119513",
> "CATMEDIA\_CDATE": "2014-01-26T20:04:11.000Z",
> "LANG\_ID": 1
> },
> "\_explanation": {
> "value": 10.882705,
> "description": "weight(DISPLAY\_NAME:happy in 853)
> [PerFieldSimilarity], result of:",
> "details": [
> {
> "value": 10.882705,
> "description": "fieldWeight in 853, product
> of:",
> "details": [
> {
> "value": 1,
> "description": "tf(freq=1.0), with
> freq of:",
> "details": [
> {
> "value": 1,
> "description": "termFreq=1.0"
> }
> ]
> },
> {
> "value": 10.882705,
> "description": "idf(docFreq=63,
> maxDocs=1253673)"
> },
> {
> "value": 1,
> "description": "fieldNorm(doc=853)"
> }
> ]
> }
> ]
> }
>
> \*Result on second run : \*
> "\_shard": 2,
> "\_node": "UOjX2lxhR6mzfjHHmTm3cQ",
> "\_index": "jdbc\_dev",
> "\_type": "media",
> "\_id": "_15939_",
> "\_score": _10.388683_,
> "\_source": {
> "DISPLAY\_NAME": "_Happy_",
> "PRICE": 1.5,
> "AUDIO": "
> [http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3](http://musicube.thecube.my/base/preview/054/540152/540152-MP3-CMT-P.mp3)",
> "CHANNEL\_ID": 1,
> "CAT\_PARENT": 557,
> "MEDIA\_ID": 15939,
> "GENRE": "Happy",
> "MEDIA\_PKEY": "540152",
> "COMPOSER": null,
> "PLAYER": null,
> "CATMEDIA\_NAME": "Happy",
> "FTID": null,
> "VIEW\_ID": 241,
> "POSITION": 6162,
> "ITEMCODE": "147237",
> "CAT\_ID": 558,
> "PRIORITY": 100,
> "CKEY": 533868,
> "CATMEDIA\_RANK": 3,
> "BILLINGTYPE\_ID": 1,
> "CAT\_NAME": "POP",
> "KEYWORDS": null,
> "LONG\_DESCRIPTION": null,
> "SHORT\_DESCRIPTION": null,
> "TYPE\_ID": 76,
> "ARTIST\_GENDER": null,
> "PERFORMER": "Diandra Arjunaidi",
> "MAPPINGS": "1\_241\_558\_POP\_557\_6162\_1.5",
> "SHORTCODE": "0401119513",
> "CATMEDIA\_CDATE": "2014-01-26T20:04:11.000Z",
> "LANG\_ID": 1
> },
> "\_explanation": {
> "value": 10.388683,
> "description": "weight(DISPLAY\_NAME:happy in 12392)
> [PerFieldSimilarity], result of:",
> "details": [
> {
> "value": 10.388683,
> "description": "fieldWeight in 12392, product
> of:",
> "details": [
> {
> "value": 1,
> "description": "tf(freq=1.0), with
> freq of:",
> "details": [
> {
> "value": 1,
> "description": "termFreq=1.0"
> }
> ]
> },
> {
> "value": 10.388683,
> "description": "idf(docFreq=107,
> maxDocs=1290854)"
> },
> {
> "value": 1,
> "description": "fieldNorm(doc=12392)"
> }
> ]
> }
> ]
> }
>
> _The mapping :_
> {
> "media": {
> "properties": {
> "AUDIO": {
> "type": "string"
> },
> "BILLINGTYPE\_ID": {
> "type": "long"
> },
> "CATMEDIA\_CDATE": {
> "type": "date",
> "format": "dateOptionalTime"
> },
> "CATMEDIA\_NAME": {
> "type": "string"
> },
> "CATMEDIA\_RANK": {
> "type": "long"
> },
> "CAT\_ID": {
> "type": "long"
> },
> "CAT\_NAME": {
> "type": "string",
> "analyzer": "string\_lowercase",
> "include\_in\_all": true
> },
> "CAT\_PARENT": {
> "type": "long"
> },
> "CHANNEL\_ID": {
> "type": "long"
> },
> "CKEY": {
> "type": "long"
> },
> "_DISPLAY\_NAME_": {
> "type": "string"
> },
> "FTID": {
> "type": "string"
> },
> "GENRE": {
> "type": "string"
> },
> "ITEMCODE": {
> "type": "string"
> },
> "KEYWORDS": {
> "type": "string"
> },
> "LANG\_ID": {
> "type": "long"
> },
> "LONG\_DESCRIPTION": {
> "type": "string"
> },
> "MAPPINGS": {
> "type": "string",
> "analyzer": "string\_lowercase",
> "include\_in\_all": true
> },
> "MEDIA\_ID": {
> "type": "long"
> },
> "MEDIA\_PKEY": {
> "type": "string"
> },
> "PERFORMER": {
> "type": "string"
> },
> "PLAYER": {
> "type": "string"
> },
> "POSITION": {
> "type": "long"
> },
> "PRICE": {
> "type": "double"
> },
> "PRIORITY": {
> "type": "long"
> },
> "SHORTCODE": {
> "type": "string"
> },
> "SHORT\_DESCRIPTION": {
> "type": "string"
> },
> "TYPE\_ID": {
> "type": "long"
> },
> "VIEW\_ID": {
> "type": "long"
> }
> }
> }
> }
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "elasticsearch" group.
> To unsubscribe from this topic, visit
> [https://groups.google.com/d/topic/elasticsearch/gQJD9oZNCpM/unsubscribe](https://groups.google.com/d/topic/elasticsearch/gQJD9oZNCpM/unsubscribe).
> To unsubscribe from this group and all its topics, send an email to
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/3507a1ac-3451-44f0-afd5-f16db6865fb1%40googlegroups.com?utm_medium=email&utm_source=footer)
> .
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
Regards,
Chee Hoo
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGS0%2Bg-N8jFZFRdg8kCSurhNUD95BfNRz\_RwxGJudLr-Q\_S4CA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGS0%2Bg-N8jFZFRdg8kCSurhNUD95BfNRz_RwxGJudLr-Q_S4CA%40mail.gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@Binh\_Ly\_2](https://discuss.elastic.co/u/Binh_Ly_2)
#### Post date: [April 4, 2014, 8:01pm UTC](https://discuss.elastic.co/t/intermittent-scoring-returned/16784/3 "2014-04-04T20:01:42Z")
The scores may differ from primary to replica because the scoring (at the
moment) takes into account information from deleted documents. Since
segment merging happens independently between shards (or primaries and
replicas), documents marked as deleted can vary among them.
You can use ?preference to somewhat influence how/where you are searching
in terms of primaries/replicas:
[http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-preference.html#search-request-preference](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-preference.html#search-request-preference)
So something like:
curl localhost:9200/\_search?preference=xxx
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/937245a2-fa6a-4889-af85-db9d42eb184a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/937245a2-fa6a-4889-af85-db9d42eb184a%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:38am UTC](https://discuss.elastic.co/t/intermittent-scoring-returned/16784/4 "2017-07-06T01:38:04Z")