ElasticSearch 1.3.4 - Duplicate data sometimes

Hi,

I was wondering how I might be able to trouble shoot issues with duplicate
data coming back from queries.

In my query, I perform an aggregate query, something like this:

final SearchResponse searchResponse =
client()
.prepareSearch(indexName)
.setTypes("OBJ_TYPE")
.setFetchSource(true)
.setExplain(true)
.addSort("dateCreated.value", SortOrder.DESC)
.addSort("recId", SortOrder.DESC)
.setSize(1000)
.addAggregation(
AggregationBuilders.filter("filter1").filter(filterBuilder).subAggregation(rangeBuilder))
.execute().actionGet();

The values returned from this query are giving back duplicate object id's.
But only sometimes. I've looked at our elasticsearch config files and
don't see any way this could happen. The filters are only reducing based
on some attributes, I can't think of any reason this could occur.

John

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/11b5f5a9-95da-40c7-aad3-00b5e79d74ad%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Ended up reducing the shard count... fixed the issue.

On Thursday, November 20, 2014 11:51:45 AM UTC-5, John D. Ament wrote:

Hi,

I was wondering how I might be able to trouble shoot issues with duplicate
data coming back from queries.

In my query, I perform an aggregate query, something like this:

final SearchResponse searchResponse =
client()
.prepareSearch(indexName)
.setTypes("OBJ_TYPE")
.setFetchSource(true)
.setExplain(true)
.addSort("dateCreated.value", SortOrder.DESC)
.addSort("recId", SortOrder.DESC)
.setSize(1000)
.addAggregation(

AggregationBuilders.filter("filter1").filter(filterBuilder).subAggregation(rangeBuilder))
.execute().actionGet();

The values returned from this query are giving back duplicate object id's.
But only sometimes. I've looked at our elasticsearch config files and
don't see any way this could happen. The filters are only reducing based
on some attributes, I can't think of any reason this could occur.

John

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/19882c91-1cf2-49ec-ace7-406abe1f6c97%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.