# Search / aggregate across multiple ES clusters?

**URL:** <https://discuss.elastic.co/t/search-aggregate-across-multiple-es-clusters/4885>\
**Category:** Elasticsearch\
**Created:** [July 18, 2011, 7:24pm UTC](https://discuss.elastic.co/t/search-aggregate-across-multiple-es-clusters/4885 "2011-07-18T19:24:37Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![tomjohnson3](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tomjohnson3/32/3368_2.png) [@tomjohnson3](https://discuss.elastic.co/u/tomjohnson3)\
**Post date:** [July 18, 2011, 7:24pm UTC](https://discuss.elastic.co/t/search-aggregate-across-multiple-es-clusters/4885/1 "2011-07-18T19:24:37Z")

</div>

hi,

i'm just starting out with elasticsearch. (very cool project, btw!)

i'd like to get some advice on how best to search multiple independent  
ES clusters (each with common indices/types) from a central point and  
aggregate the results.

here's my scenario: i have several several remote groups of servers  
that generate data that i'd like to search using ES. because of  
various constraints (firewalls, multiple customers w/independent  
servers, etc.), it would be difficult to have ES nodes in each group  
connect together to form one large "ES cluster."

however, it would be easy (in theory) to connect from a central server  
to the independent groups, execute a search on a _dedicated_ ES  
cluster in the group, then aggregate the results. (this would allow us  
to execute searches on subsets of clusters, which is  
important.) ...but the _aggregation_ part is the unknown for me.

since each cluster would use common naming conventions for indices and  
types, perhaps we could aggregate results from separate ES clusters as  
ES does behind-the-scenes for results from multiple nodes within a  
cluster? (i have yet to dig into that part of the code.)

or, are there any features like this (to work with multiple  
independent clusters w/common indices/types) on the horizon?

...any help / pointers / etc. would be greatly appreciated.

thanks, tom

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [July 18, 2011, 10:24pm UTC](https://discuss.elastic.co/t/search-aggregate-across-multiple-es-clusters/4885/2 "2011-07-18T22:24:02Z")

</div>

Heya,

There is no support for aggregating results across clusters. You can try  
and aggregate it yourself, but that would be hard when ti comes to facets  
and the like and will loose functionality. There is no plan to support  
this...

-shay.banon

On Mon, Jul 18, 2011 at 10:24 PM, tj [tomjohnson3@gmail.com](mailto:tomjohnson3@gmail.com) wrote:

> hi,
> 
> i'm just starting out with elasticsearch. (very cool project, btw!)
> 
> i'd like to get some advice on how best to search multiple independent  
> ES clusters (each with common indices/types) from a central point and  
> aggregate the results.
> 
> here's my scenario: i have several several remote groups of servers  
> that generate data that i'd like to search using ES. because of  
> various constraints (firewalls, multiple customers w/independent  
> servers, etc.), it would be difficult to have ES nodes in each group  
> connect together to form one large "ES cluster."
> 
> however, it would be easy (in theory) to connect from a central server  
> to the independent groups, execute a search on a _dedicated_ ES  
> cluster in the group, then aggregate the results. (this would allow us  
> to execute searches on subsets of clusters, which is  
> important.) ...but the _aggregation_ part is the unknown for me.
> 
> since each cluster would use common naming conventions for indices and  
> types, perhaps we could aggregate results from separate ES clusters as  
> ES does behind-the-scenes for results from multiple nodes within a  
> cluster? (i have yet to dig into that part of the code.)
> 
> or, are there any features like this (to work with multiple  
> independent clusters w/common indices/types) on the horizon?
> 
> ...any help / pointers / etc. would be greatly appreciated.
> 
> thanks, tom

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:00am UTC](https://discuss.elastic.co/t/search-aggregate-across-multiple-es-clusters/4885/3 "2017-07-06T04:00:13Z")

</div>


