# Search results not uniform **URL:** \ **Category:** Elasticsearch\ **Created:** [July 20, 2010, 1:48pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124 "2010-07-20T13:48:43Z")\ **Posts on this page:** 8\ **Page:** 1

**Author:** ![ajgamer](https://avatars.discourse-cdn.com/v4/letter/a/7ab992/32.png) [@ajgamer](https://discuss.elastic.co/u/ajgamer)\ **Post date:** [July 20, 2010, 1:48pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/1 "2010-07-20T13:48:43Z")

Hello, When i do a search query using http://\*\*\*. **_._.** :9200/tournament/master/\_search?q=995 i get multiple results(not sure why). The result(s) i get are: \* \_index: "tournament" \* \_type: "master" \* \_id: "995" \* - \_source: { o tournamentid: 995 o startdate: "2010-07-19T18:30:00.000Z" o enddate: "2010-07-22T18:30:00.000Z" o initiator: "system-gen" o largeimage: 1735 o thumbimage: 1130 o gamename: "Avoid Responsibility" o gamedescription: " It's your chance to keep the responsibilities at bay.This is your destiny " } And when i do a refresh i get: ``` * _index: "tournament" * _type: "master" * _id: "995" * - _source: { o tournamentid: 995 startdate: "2010-07-20T07:35:00.000Z" enddate: "2010-07-23T07:35:00.000Z" o initiator: "system-gen" o largeimage: 1735 o thumbimage: 1130 o gamename: "Avoid Responsibility" o gamedescription: "

It's your chance to keep the responsibilities at bay.This is your destiny " } Notice the different start date and end dates. ---

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 20, 2010, 1:55pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/2 "2010-07-20T13:55:25Z")

elasticsearch results are near real time, not full real time, this means that if you update a document with the same id, that update will only be "visible" after a certain period (or once you call refresh, which is an expensive operations potentially, should not be called for every request). -shay.banon On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com) wrote: > Hello, > > When i do a search query using http:// > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > i get multiple results(not sure why). The result(s) i get are: > > - \_index: "tournament" > - \_type: "master" > - \_id: "995" > - > - > > \_source: { > o tournamentid: 995 > o startdate: "2010-07-19T18:30:00.000Z" > o enddate: "2010-07-22T18:30:00.000Z" > o initiator: "system-gen" > o largeimage: 1735 > o thumbimage: 1130 > o gamename: "Avoid Responsibility" > o gamedescription: " > > It's your chance to keep the responsibilities at bay.This is > your destiny > > " > } > > And when i do a refresh i get: > > - \_index: "tournament" > - \_type: "master" > - \_id: "995" > - > - > > \_source: { > o tournamentid: 995 > startdate: "2010-07-20T07:35:00.000Z" > enddate: "2010-07-23T07:35:00.000Z" > o initiator: "system-gen" > o largeimage: 1735 > o thumbimage: 1130 > o gamename: "Avoid Responsibility" > o gamedescription: " > > It's your chance to keep the responsibilities at bay.This is > your destiny > > " > } > > Notice the different start date and end dates. ---

**Author:** ![Franz\_Allan\_Valencia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/franz_allan_valencia/32/3326_2.png) [@Franz\_Allan\_Valencia](https://discuss.elastic.co/u/Franz_Allan_Valencia)\ **Post date:** [July 20, 2010, 2:01pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/3 "2010-07-20T14:01:57Z")

Curious, how about if org.elasticsearch.action.index.IndexRequest#operationThreaded(..) is set to 'true', will it assure that after org.elasticsearch.action.ActionFuture#actionGet() finishes execution that the index will be updated already? ## Thanks, Franz Allan Valencia See | Java Software Engineer [franz.see@gmail.com](mailto:franz.see@gmail.com) LinkedIn: [http://www.linkedin.com/in/franzsee](http://www.linkedin.com/in/franzsee) Twitter: [http://www.twitter.com/franz\_see](http://www.twitter.com/franz_see) On Tue, Jul 20, 2010 at 9:55 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote: > elasticsearch results are near real time, not full real time, this means > that if you update a document with the same id, that update will only be > "visible" after a certain period (or once you call refresh, which is an > expensive operations potentially, should not be called for every request). > > -shay.banon > > On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com) wrote: > > > Hello, > > > > When i do a search query using http:// > > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > > i get multiple results(not sure why). The result(s) i get are: > > > > - \_index: "tournament" > > - \_type: "master" > > - \_id: "995" > > - > > - > > > > \_source: { > > o tournamentid: 995 > > o startdate: "2010-07-19T18:30:00.000Z" > > o enddate: "2010-07-22T18:30:00.000Z" > > o initiator: "system-gen" > > o largeimage: 1735 > > o thumbimage: 1130 > > o gamename: "Avoid Responsibility" > > o gamedescription: " > > > > It's your chance to keep the responsibilities at bay.This is > > your destiny > > > > " > > } > > > > And when i do a refresh i get: > > > > - \_index: "tournament" > > - \_type: "master" > > - \_id: "995" > > - > > - > > > > \_source: { > > o tournamentid: 995 > > startdate: "2010-07-20T07:35:00.000Z" > > enddate: "2010-07-23T07:35:00.000Z" > > o initiator: "system-gen" > > o largeimage: 1735 > > o thumbimage: 1130 > > o gamename: "Avoid Responsibility" > > o gamedescription: " > > > > It's your chance to keep the responsibilities at bay.This is > > your destiny > > > > " > > } > > > > Notice the different start date and end dates. ---

**Author:** ![ajgamer](https://avatars.discourse-cdn.com/v4/letter/a/7ab992/32.png) [@ajgamer](https://discuss.elastic.co/u/ajgamer)\ **Post date:** [July 20, 2010, 2:19pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/4 "2010-07-20T14:19:39Z")

Hi Shay, Thanks for your reply. The document was updated some 3 hrs before i checked for this behavior. The strange thing here is when i refresh the page continuously(say 5 times) the data remains constant, but when i come back and refresh the page the date record changes again. On Tue, Jul 20, 2010 at 7:25 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote: > elasticsearch results are near real time, not full real time, this means > that if you update a document with the same id, that update will only be > "visible" after a certain period (or once you call refresh, which is an > expensive operations potentially, should not be called for every request). > > -shay.banon > > On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com) wrote: > > > Hello, > > > > When i do a search query using http:// > > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > > i get multiple results(not sure why). The result(s) i get are: > > > > - \_index: "tournament" > > - \_type: "master" > > - \_id: "995" > > - > > - > > > > \_source: { > > o tournamentid: 995 > > o startdate: "2010-07-19T18:30:00.000Z" > > o enddate: "2010-07-22T18:30:00.000Z" > > o initiator: "system-gen" > > o largeimage: 1735 > > o thumbimage: 1130 > > o gamename: "Avoid Responsibility" > > o gamedescription: " > > > > It's your chance to keep the responsibilities at bay.This is > > your destiny > > > > " > > } > > > > And when i do a refresh i get: > > > > - \_index: "tournament" > > - \_type: "master" > > - \_id: "995" > > - > > - > > > > \_source: { > > o tournamentid: 995 > > startdate: "2010-07-20T07:35:00.000Z" > > enddate: "2010-07-23T07:35:00.000Z" > > o initiator: "system-gen" > > o largeimage: 1735 > > o thumbimage: 1130 > > o gamename: "Avoid Responsibility" > > o gamedescription: " > > > > It's your chance to keep the responsibilities at bay.This is > > your destiny > > > > " > > } > > > > Notice the different start date and end dates. ---

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 20, 2010, 5:29pm UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/5 "2010-07-20T17:29:19Z")

Maybe its caching done on the client side? Do you use the REST API using javascript? Maybe I should add a no cache header or something to the response. -shay.banon On Tue, Jul 20, 2010 at 5:19 PM, Abbie Joseph [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > Hi Shay, > > Thanks for your reply. The document was updated some 3 hrs before i checked > for this behavior. The strange thing here is when i refresh the page > continuously(say 5 times) the data remains constant, but when i come back > and refresh the page the date record changes again. > > On Tue, Jul 20, 2010 at 7:25 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote: > > > elasticsearch results are near real time, not full real time, this means > > that if you update a document with the same id, that update will only be > > "visible" after a certain period (or once you call refresh, which is an > > expensive operations potentially, should not be called for every request). > > > > -shay.banon > > > > On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com) wrote: > > > > > Hello, > > > > > > When i do a search query using http:// > > > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > > > i get multiple results(not sure why). The result(s) i get are: > > > > > > - \_index: "tournament" > > > - \_type: "master" > > > - \_id: "995" > > > - > > > - > > > > > > \_source: { > > > o tournamentid: 995 > > > o startdate: "2010-07-19T18:30:00.000Z" > > > o enddate: "2010-07-22T18:30:00.000Z" > > > o initiator: "system-gen" > > > o largeimage: 1735 > > > o thumbimage: 1130 > > > o gamename: "Avoid Responsibility" > > > o gamedescription: " > > > > > > It's your chance to keep the responsibilities at bay.This is > > > your destiny > > > > > > " > > > } > > > > > > And when i do a refresh i get: > > > > > > - \_index: "tournament" > > > - \_type: "master" > > > - \_id: "995" > > > - > > > - > > > > > > \_source: { > > > o tournamentid: 995 > > > startdate: "2010-07-20T07:35:00.000Z" > > > enddate: "2010-07-23T07:35:00.000Z" > > > o initiator: "system-gen" > > > o largeimage: 1735 > > > o thumbimage: 1130 > > > o gamename: "Avoid Responsibility" > > > o gamedescription: " > > > > > > It's your chance to keep the responsibilities at bay.This is > > > your destiny > > > > > > " > > > } > > > > > > Notice the different start date and end dates. ---

**Author:** ![ajgamer](https://avatars.discourse-cdn.com/v4/letter/a/7ab992/32.png) [@ajgamer](https://discuss.elastic.co/u/ajgamer)\ **Post date:** [July 21, 2010, 6:13am UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/6 "2010-07-21T06:13:16Z")

We are not doing anything client side. What we are doing is a bulk update of data from MySql to Elasticsearch. Do i need to take care of anything while i do bulk updates?. Is it due to data getting replicating in multiple shards() and maybe the shards have different data in them?. My schema for shards look like this: "meta-data" : { "max\_number\_of\_shards\_per\_node" : 100, "indices" : { "tournament" : { "settings" : { "index.number\_of\_shards" : "5", "index.number\_of\_replicas" : "4" }. BTW i now see a constant data in the date field as startdate: "2010-07-19T18:30:00.000Z" and when i do an explain=true i now see \_explanation: { - value: 1 - description: "ConstantScoreQuery(QueryWrapperFilter(tournamentid: On Tue, Jul 20, 2010 at 10:59 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote: > Maybe its caching done on the client side? Do you use the REST API using > javascript? Maybe I should add a no cache header or something to the > response. > > -shay.banon > > On Tue, Jul 20, 2010 at 5:19 PM, Abbie Joseph [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > > > Hi Shay, > > > > Thanks for your reply. The document was updated some 3 hrs before i > > checked for this behavior. The strange thing here is when i refresh the page > > continuously(say 5 times) the data remains constant, but when i come back > > and refresh the page the date record changes again. > > > > On Tue, Jul 20, 2010 at 7:25 PM, Shay Banon \<[shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com) > > > > > wrote: > > > > > elasticsearch results are near real time, not full real time, this means > > > that if you update a document with the same id, that update will only be > > > "visible" after a certain period (or once you call refresh, which is an > > > expensive operations potentially, should not be called for every request). > > > > > > -shay.banon > > > > > > On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > > > > > > > Hello, > > > > > > > > When i do a search query using http:// > > > > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > > > > i get multiple results(not sure why). The result(s) i get are: > > > > > > > > - \_index: "tournament" > > > > - \_type: "master" > > > > - \_id: "995" > > > > - > > > > - > > > > > > > > \_source: { > > > > o tournamentid: 995 > > > > o startdate: "2010-07-19T18:30:00.000Z" > > > > o enddate: "2010-07-22T18:30:00.000Z" > > > > o initiator: "system-gen" > > > > o largeimage: 1735 > > > > o thumbimage: 1130 > > > > o gamename: "Avoid Responsibility" > > > > o gamedescription: " > > > > > > > > It's your chance to keep the responsibilities at bay.This is > > > > your destiny > > > > > > > > " > > > > } > > > > > > > > And when i do a refresh i get: > > > > > > > > - \_index: "tournament" > > > > - \_type: "master" > > > > - \_id: "995" > > > > - > > > > - > > > > > > > > \_source: { > > > > o tournamentid: 995 > > > > startdate: "2010-07-20T07:35:00.000Z" > > > > enddate: "2010-07-23T07:35:00.000Z" > > > > o initiator: "system-gen" > > > > o largeimage: 1735 > > > > o thumbimage: 1130 > > > > o gamename: "Avoid Responsibility" > > > > o gamedescription: " > > > > > > > > It's your chance to keep the responsibilities at bay.This is > > > > your destiny > > > > > > > > " > > > > } > > > > > > > > Notice the different start date and end dates. ---

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 21, 2010, 7:18am UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/7 "2010-07-21T07:18:33Z")

Yes, problem in replication might explain this. I fixed (a very rare corner case) that might explain this in 0.9, can you give it a go. p.s. Maan, this 0.9 version must come out already, not really nice of me to ask this all the time from users 😉 -shay.banon On Wed, Jul 21, 2010 at 9:13 AM, Abbie Joseph [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > We are not doing anything client side. What we are doing is a bulk update > of data from MySql to Elasticsearch. Do i need to take care of anything > while i do bulk updates?. Is it due to data getting replicating in multiple > shards() and maybe the shards have different data in them?. My schema for > shards look like this: > > "meta-data" : { > "max\_number\_of\_shards\_per\_node" : 100, > "indices" : { > "tournament" : { > "settings" : { > "index.number\_of\_shards" : "5", > "index.number\_of\_replicas" : "4" > }. > > BTW i now see a constant data in the date field as startdate: > "2010-07-19T18:30:00.000Z" and when i do an explain=true i now see > \_explanation: { > > - value: 1 > - description: "ConstantScoreQuery(QueryWrapperFilter(tournamentid: > > On Tue, Jul 20, 2010 at 10:59 PM, Shay Banon \<[shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com) > > > wrote: > > > Maybe its caching done on the client side? Do you use the REST API using > > javascript? Maybe I should add a no cache header or something to the > > response. > > > > -shay.banon > > > > On Tue, Jul 20, 2010 at 5:19 PM, Abbie Joseph [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > > > > > Hi Shay, > > > > > > Thanks for your reply. The document was updated some 3 hrs before i > > > checked for this behavior. The strange thing here is when i refresh the page > > > continuously(say 5 times) the data remains constant, but when i come back > > > and refresh the page the date record changes again. > > > > > > On Tue, Jul 20, 2010 at 7:25 PM, Shay Banon \< > > > [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)\> wrote: > > > > > > > elasticsearch results are near real time, not full real time, this means > > > > that if you update a document with the same id, that update will only be > > > > "visible" after a certain period (or once you call refresh, which is an > > > > expensive operations potentially, should not be called for every request). > > > > > > > > -shay.banon > > > > > > > > On Tue, Jul 20, 2010 at 4:48 PM, ajgamer [abie.joseph14@gmail.com](mailto:abie.joseph14@gmail.com)wrote: > > > > > > > > > Hello, > > > > > > > > > > When i do a search query using http:// > > > > > _ **.** _.\*.\*\*:9200/tournament/master/\_search?q=995 > > > > > i get multiple results(not sure why). The result(s) i get are: > > > > > > > > > > - \_index: "tournament" > > > > > - \_type: "master" > > > > > - \_id: "995" > > > > > - > > > > > - > > > > > > > > > > \_source: { > > > > > o tournamentid: 995 > > > > > o startdate: "2010-07-19T18:30:00.000Z" > > > > > o enddate: "2010-07-22T18:30:00.000Z" > > > > > o initiator: "system-gen" > > > > > o largeimage: 1735 > > > > > o thumbimage: 1130 > > > > > o gamename: "Avoid Responsibility" > > > > > o gamedescription: " > > > > > > > > > > It's your chance to keep the responsibilities at bay.This is > > > > > your destiny > > > > > > > > > > " > > > > > } > > > > > > > > > > And when i do a refresh i get: > > > > > > > > > > - \_index: "tournament" > > > > > - \_type: "master" > > > > > - \_id: "995" > > > > > - > > > > > - > > > > > > > > > > \_source: { > > > > > o tournamentid: 995 > > > > > startdate: "2010-07-20T07:35:00.000Z" > > > > > enddate: "2010-07-23T07:35:00.000Z" > > > > > o initiator: "system-gen" > > > > > o largeimage: 1735 > > > > > o thumbimage: 1130 > > > > > o gamename: "Avoid Responsibility" > > > > > o gamedescription: " > > > > > > > > > > It's your chance to keep the responsibilities at bay.This is > > > > > your destiny > > > > > > > > > > " > > > > > } > > > > > > > > > > Notice the different start date and end dates. ---

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:21am UTC](https://discuss.elastic.co/t/search-results-not-uniform/3124/8 "2017-07-06T04:21:57Z")