# Elasticsearch and Hadoop on the same cluster
**URL:** https://discuss.elastic.co/t/elasticsearch-and-hadoop-on-the-same-cluster/21631
**Category:** Elasticsearch
**Created:** [January 14, 2015, 10:04am UTC](https://discuss.elastic.co/t/elasticsearch-and-hadoop-on-the-same-cluster/21631 "2015-01-14T10:04:12Z")
**Posts on this page:** 3
**Page:** 1
### Author:  [@Charles\_Vallee](https://discuss.elastic.co/u/Charles_Vallee)
#### Post date: [January 14, 2015, 10:04am UTC](https://discuss.elastic.co/t/elasticsearch-and-hadoop-on-the-same-cluster/21631/1 "2015-01-14T10:04:12Z")
Greatings everyone, I repost this just in case :
The Elasticseach-hadoop current guide mentions a two clusters
configurations: eslasticsearch-hadoop handles communications between the
Hadoop cluster and the Elasticsearch one.
Link :
[http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/arch.html](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/arch.html)
I am wondering about the other obvious configuration: one of shared nodes,
consisting in one cluster for both Hadoop and Elasticsearch. The case is
mentioned in Elasticsearch-Hortonworks' presentation (slides 31-32) :
> **[Combine Apache Hadoop and Elasticsearch to Get the Most of Your Big D…](https://fr.slideshare.net/hortonworks/hortonworks-elastic-searchfinal)**
>
> Hadoop is a great platform for storing and processing massive amounts of data. Elasticsearch is the ideal solution for Searching and Visualizing the same data.…
How would one implement Hadoop and Elasticsearch on the same cluster?
Would there be any trouble between Hadoop ZooKeeper and Elasticsearch's own
cluster management?
Thanks to all for paying attention!
Charles
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@costin](https://discuss.elastic.co/u/costin)
#### Post date: [January 14, 2015, 11:24am UTC](https://discuss.elastic.co/t/elasticsearch-and-hadoop-on-the-same-cluster/21631/2 "2015-01-14T11:24:03Z")
Hi Charles,
No need to repost - if you are looking for real-time replies, try the IRC.
What exactly are you looking for? Elasticsearch and Hadoop are 'services' that can share the same hardware.
Since ES does not depend on Hadoop or vice-versa, you can install each one as you typically do - the more hardware, the
better.
You basically end up with two 'software' clusters on top of a hardware one. The advantage here is that you can mix and
match:
you can choose to allocate a different number of machines to ES vs Hadoop; some machines can be shared while others
aren't - it's your choice.
There's no "implementation" to be done - you just install them one by one and if you want to run your Hadoop jobs
against ES,
use es-hadoop (the documentation contains plenty of examples for each library that you might use from Map/Reduce to Spark).
On 1/14/15 12:04 PM, Charles Vallée wrote:
> Greatings everyone, I repost this just in case :
>
> The Elasticseach-hadoop current guide mentions a two clusters configurations: eslasticsearch-hadoop handles
> communications between the Hadoop cluster and the Elasticsearch one.
> Link : [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/arch.html)
> [http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/arch.html](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/arch.html)
>
> I am wondering about the other obvious configuration: one of shared nodes, consisting in one cluster for both Hadoop and
> Elasticsearch. The case is mentioned in Elasticsearch-Hortonworks' presentation (slides 31-32) :
> [Combine Apache Hadoop and Elasticsearch to Get the Most of Your Big Data | PPT](http://fr.slideshare.net/hortonworks/hortonworks-elastic-searchfinal)
> [http://fr.slideshare.net/hortonworks/hortonworks-elastic-searchfinal](http://fr.slideshare.net/hortonworks/hortonworks-elastic-searchfinal)
>
> How would one implement Hadoop and Elasticsearch on the same cluster?
> Would there be any trouble between Hadoop ZooKeeper and Elasticsearch's own cluster management?
>
> Thanks to all for paying attention!
>
> Charles
>
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> To view this discussion on the web visit
> [https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com)
> [https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5c186974-78b9-4d34-9271-ca32b653c5bb%40googlegroups.com?utm_medium=email&utm_source=footer).
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
--
Costin
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/54B651D3.1070106%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/54B651D3.1070106%40gmail.com).
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 12:39am UTC](https://discuss.elastic.co/t/elasticsearch-and-hadoop-on-the-same-cluster/21631/3 "2017-07-06T00:39:04Z")