# Ignoring duplicates when searching across multiple indices

**URL:** <https://discuss.elastic.co/t/ignoring-duplicates-when-searching-across-multiple-indices/10769>\
**Category:** Elasticsearch\
**Created:** [February 18, 2013, 10:38am UTC](https://discuss.elastic.co/t/ignoring-duplicates-when-searching-across-multiple-indices/10769 "2013-02-18T10:38:56Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lion\_Vollnhals](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lion_vollnhals/32/2485_2.png) [@Lion\_Vollnhals](https://discuss.elastic.co/u/Lion_Vollnhals)\
**Post date:** [February 18, 2013, 10:38am UTC](https://discuss.elastic.co/t/ignoring-duplicates-when-searching-across-multiple-indices/10769/1 "2013-02-18T10:38:56Z")

</div>

Hello,

we have two indices, a global article index and a specific shop article  
index.  
The shop article index may contain articles that are already in the global  
article index.  
These articles may have more information than there global counterparts.

We formulate queries across both indices at once using the multiple indices  
api.  
How can we discard duplicates?

Regards,  
Lion

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [February 18, 2013, 1:08pm UTC](https://discuss.elastic.co/t/ignoring-duplicates-when-searching-across-multiple-indices/10769/2 "2013-02-18T13:08:32Z")

</div>

Either you search only a list of specific shops, or the global index. If  
you search both, your design implies you want duplicates (and to remove  
them afterwards is always clumsy)

Jörg

Am 18.02.13 11:38, schrieb Lion Vollnhals:

> Hello,
> 
> we have two indices, a global article index and a specific shop  
> article index.  
> The shop article index may contain articles that are already in the  
> global article index.  
> These articles may have more information than there global counterparts.
> 
> We formulate queries across both indices at once using the multiple  
> indices api.  
> How can we discard duplicates?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:50am UTC](https://discuss.elastic.co/t/ignoring-duplicates-when-searching-across-multiple-indices/10769/3 "2017-07-06T02:50:58Z")

</div>