# Intercommunication between machines in ElasticSearch

**URL:** <https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521>\
**Category:** Elasticsearch\
**Created:** [May 1, 2012, 1:23pm UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521 "2012-05-01T13:23:40Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Dennis](https://avatars.discourse-cdn.com/v4/letter/d/e56c9b/32.png) [@Dennis](https://discuss.elastic.co/u/Dennis)\
**Post date:** [May 1, 2012, 1:23pm UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/1 "2012-05-01T13:23:40Z")

</div>

I'm trying to wrap my head around the issues of using the Java API and how  
the internals of ElasticSearch (ES) work. In fact, the organization of a  
large ES installation would be nice to have cleared up.

Let's say I wanted to create a large multinational, multilingual site.  
There'd be data centers in various cities of the world, each set with the  
country/language locale, each with local content. My goal is to have those  
searchable from around the world, based on some small amount of translation  
upon data insertion.

How would the clusters, nodes, etc be set up to talk to each other? And  
what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 2, 2012, 4:27pm UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/2 "2012-05-02T16:27:50Z")

</div>

You mean each data center will have its own set of data, and own set of  
machines? You can have an ES cluster (or a singel node) per data center in  
this case, each responsible for its own content.

On Tue, May 1, 2012 at 4:23 PM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:

> I'm trying to wrap my head around the issues of using the Java API and how  
> the internals of Elasticsearch (ES) work. In fact, the organization of a  
> large ES installation would be nice to have cleared up.
> 
> Let's say I wanted to create a large multinational, multilingual site.  
> There'd be data centers in various cities of the world, each set with the  
> country/language locale, each with local content. My goal is to have those  
> searchable from around the world, based on some small amount of translation  
> upon data insertion.
> 
> How would the clusters, nodes, etc be set up to talk to each other? And  
> what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![Dennis](https://avatars.discourse-cdn.com/v4/letter/d/e56c9b/32.png) [@Dennis](https://discuss.elastic.co/u/Dennis)\
**Post date:** [May 3, 2012, 1:34am UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/3 "2012-05-03T01:34:46Z")

</div>

How easy would it be to make local data be master at each site, and slave  
clusters of data from other locations, so searching would be done locally  
on real-time-local-data and on lazily updated remote data (from other  
locales)?

On Wednesday, May 2, 2012 11:27:50 AM UTC-5, kimchy wrote:

> You mean each data center will have its own set of data, and own set of  
> machines? You can have an ES cluster (or a singel node) per data center in  
> this case, each responsible for its own content.
> 
> On Tue, May 1, 2012 at 4:23 PM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:
> 
> > I'm trying to wrap my head around the issues of using the Java API and  
> > how the internals of Elasticsearch (ES) work. In fact, the organization of  
> > a large ES installation would be nice to have cleared up.
> > 
> > Let's say I wanted to create a large multinational, multilingual site.  
> > There'd be data centers in various cities of the world, each set with the  
> > country/language locale, each with local content. My goal is to have those  
> > searchable from around the world, based on some small amount of translation  
> > upon data insertion.
> > 
> > How would the clusters, nodes, etc be set up to talk to each other? And  
> > what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\
**Post date:** [May 3, 2012, 4:52am UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/4 "2012-05-03T04:52:48Z")

</div>

I don't really follow what you are asking.... Maybe you could describe what  
you ultimately want to (be able to) do?

## Otis

Performance Monitoring for Solr / Elasticsearch / HBase -

> **[Sematext Monitoring | Infrastructure Monitoring Service](https://sematext.com/spm)**
>
> Bring together your servers, Apps, Metrics, Logs & Events ✓ Over 40 integrations to easily collect metrics & events across your whole stack ✓ Start now!

On Wednesday, May 2, 2012 9:34:46 PM UTC-4, Dennis wrote:

> How easy would it be to make local data be master at each site, and slave  
> clusters of data from other locations, so searching would be done locally  
> on real-time-local-data and on lazily updated remote data (from other  
> locales)?
> 
> On Wednesday, May 2, 2012 11:27:50 AM UTC-5, kimchy wrote:
> 
> > You mean each data center will have its own set of data, and own set of  
> > machines? You can have an ES cluster (or a singel node) per data center in  
> > this case, each responsible for its own content.
> > 
> > On Tue, May 1, 2012 at 4:23 PM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:
> > 
> > > I'm trying to wrap my head around the issues of using the Java API and  
> > > how the internals of Elasticsearch (ES) work. In fact, the organization of  
> > > a large ES installation would be nice to have cleared up.
> > > 
> > > Let's say I wanted to create a large multinational, multilingual site.  
> > > There'd be data centers in various cities of the world, each set with the  
> > > country/language locale, each with local content. My goal is to have those  
> > > searchable from around the world, based on some small amount of translation  
> > > upon data insertion.
> > > 
> > > How would the clusters, nodes, etc be set up to talk to each other? And  
> > > what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [May 4, 2012, 9:47am UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/5 "2012-05-04T09:47:04Z")

</div>

In this case, you will need to make sure to a DC will write to all other  
clusters so they will have it locally as well.

On Thu, May 3, 2012 at 4:34 AM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:

> How easy would it be to make local data be master at each site, and slave  
> clusters of data from other locations, so searching would be done locally  
> on real-time-local-data and on lazily updated remote data (from other  
> locales)?
> 
> On Wednesday, May 2, 2012 11:27:50 AM UTC-5, kimchy wrote:
> 
> > You mean each data center will have its own set of data, and own set of  
> > machines? You can have an ES cluster (or a singel node) per data center in  
> > this case, each responsible for its own content.
> > 
> > On Tue, May 1, 2012 at 4:23 PM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:
> > 
> > > I'm trying to wrap my head around the issues of using the Java API and  
> > > how the internals of Elasticsearch (ES) work. In fact, the organization of  
> > > a large ES installation would be nice to have cleared up.
> > > 
> > > Let's say I wanted to create a large multinational, multilingual site.  
> > > There'd be data centers in various cities of the world, each set with the  
> > > country/language locale, each with local content. My goal is to have those  
> > > searchable from around the world, based on some small amount of translation  
> > > upon data insertion.
> > > 
> > > How would the clusters, nodes, etc be set up to talk to each other? And  
> > > what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![Dennis](https://avatars.discourse-cdn.com/v4/letter/d/e56c9b/32.png) [@Dennis](https://discuss.elastic.co/u/Dennis)\
**Post date:** [May 17, 2012, 3:16am UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/6 "2012-05-17T03:16:40Z")

</div>

I was thinking that would be what I would have to do, Kimchy/Shay. I'll  
have to revisit this later, solving more near term design problems.

On Friday, May 4, 2012 4:47:04 AM UTC-5, kimchy wrote:

> In this case, you will need to make sure to a DC will write to all other  
> clusters so they will have it locally as well.
> 
> On Thu, May 3, 2012 at 4:34 AM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:
> 
> > How easy would it be to make local data be master at each site, and slave  
> > clusters of data from other locations, so searching would be done locally  
> > on real-time-local-data and on lazily updated remote data (from other  
> > locales)?
> > 
> > On Wednesday, May 2, 2012 11:27:50 AM UTC-5, kimchy wrote:
> > 
> > > You mean each data center will have its own set of data, and own set of  
> > > machines? You can have an ES cluster (or a singel node) per data center in  
> > > this case, each responsible for its own content.
> > > 
> > > On Tue, May 1, 2012 at 4:23 PM, Dennis [gearond@gmail.com](mailto:gearond@gmail.com) wrote:
> > > 
> > > > I'm trying to wrap my head around the issues of using the Java API and  
> > > > how the internals of Elasticsearch (ES) work. In fact, the organization of  
> > > > a large ES installation would be nice to have cleared up.
> > > > 
> > > > Let's say I wanted to create a large multinational, multilingual site.  
> > > > There'd be data centers in various cities of the world, each set with the  
> > > > country/language locale, each with local content. My goal is to have those  
> > > > searchable from around the world, based on some small amount of translation  
> > > > upon data insertion.
> > > > 
> > > > How would the clusters, nodes, etc be set up to talk to each other? And  
> > > > what is exchanged, pure JSON? What?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:28am UTC](https://discuss.elastic.co/t/intercommunication-between-machines-in-elasticsearch/7521/7 "2017-07-06T03:28:25Z")

</div>


