# Elasticsearch Cluster Inside MapR Cluster

**URL:** <https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305>\
**Category:** Elasticsearch\
**Created:** [July 24, 2018, 6:39am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305 "2018-07-24T06:39:22Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mark\_Dendrix\_Garcia](https://avatars.discourse-cdn.com/v4/letter/m/8baadc/32.png) [@Mark\_Dendrix\_Garcia](https://discuss.elastic.co/u/Mark_Dendrix_Garcia)\
**Post date:** [July 24, 2018, 6:39am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/1 "2018-07-24T06:39:22Z")

</div>

Hi Elasticsearch Team,

We are creating a Document Management System using FSCrawler, Elasticsearch & MapR-FS (File system)  
We choose a Big Data Platform since the usecases can be scaled to analytics.

And is it possible to setup a Elasticsearch cluster inside a 5 node MapR Cluster?  
Elasticsearch also uses Zookeeper, does this will work inside MapR Cluster?

If no, can we used Dockerize elasticsearch on each MapR node and create a cluster out of this dockerize ES?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 24, 2018, 6:59am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/2 "2018-07-24T06:59:22Z")

</div>

Elasticsearch does not use Zookeeper, so that is not a problem. Running Elasticsearch on a distributed file system like MapR-FS, HDFS or NFS is however not recommended/supported as it can lead to very poor performance, index corruption and instability. I would therefore recommend running a separate Elasticsearch cluster outside the MapR cluster.

---

<div class="post-metadata">

**Author:** ![Mark\_Dendrix\_Garcia](https://avatars.discourse-cdn.com/v4/letter/m/8baadc/32.png) [@Mark\_Dendrix\_Garcia](https://discuss.elastic.co/u/Mark_Dendrix_Garcia)\
**Post date:** [July 24, 2018, 9:46am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/3 "2018-07-24T09:46:58Z")

</div>

Hi,

Thanks for the response 🙂

It states here that Zookeeper is also a part of Architecture [Elasticsearch Cluster](https://www.elastic.co/guide/en/cloud-enterprise/current/_architecture.html) when deploying an Elasticsearch Cluster. Am I on the right page? please correct me if Im wrong.

About the distributed filesystem, we are not planning to put elasticsearch fs/shards to a Distributed System, tho we are going to deploy ES Cluster on MapR Nodes.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 24, 2018, 9:50am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/4 "2018-07-24T09:50:45Z")

</div>

> [@Mark\_Dendrix\_Garcia](#):
>
> It states here that Zookeeper is also a part of Architecture [Elasticsearch Cluster](https://www.elastic.co/guide/en/cloud-enterprise/current/_architecture.html) when deploying an Elasticsearch Cluster. Am I on the right page? please correct me if Im wrong.

A standalone Elasticsearch cluster does not use Zookeeper, and this is most likely what you would deploy.

Our [Elastic Cloud Enterprise](https://www.elastic.co/guide/en/cloud-enterprise/1.1/_architecture.html#ece-overview-zk) product, which is used to simplify management of multiple clusters however does use Zookeeper. I wonder if that is where the confusion comes from?

> [@Mark\_Dendrix\_Garcia](#):
>
> About the distributed filesystem, we are not planning to put elasticsearch fs/shards to a Distributed System, tho we are going to deploy ES Cluster on MapR Nodes.

Good.

---

<div class="post-metadata">

**Author:** ![Mark\_Dendrix\_Garcia](https://avatars.discourse-cdn.com/v4/letter/m/8baadc/32.png) [@Mark\_Dendrix\_Garcia](https://discuss.elastic.co/u/Mark_Dendrix_Garcia)\
**Post date:** [July 24, 2018, 10:25am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/5 "2018-07-24T10:25:21Z")

</div>

> [@Christian\_Dahlqvist](#):
>
> A standalone Elasticsearch cluster does not use Zookeeper, and this is most likely what you would deploy.
> 
> Our [Elastic Cloud Enterprise](https://www.elastic.co/guide/en/cloud-enterprise/1.1/_architecture.html#ece-overview-zk) product, which is used to simplify management of multiple clusters however does use Zookeeper. I wonder if that is where the confusion comes from?

I think this one is really confusing, Elasticsearch cluster is compose of how many servers? or cluster means a cluster of index? Im really confused, because in a big data perspective a cluster is a collection of different nodes with different roles. I already assume that I can also deploy a clusterize Elasticsearch which can bring more power and speed? but please enlighten me.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 24, 2018, 10:31am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/6 "2018-07-24T10:31:09Z")

</div>

A single Elasticsearch cluster can contain many nodes spread across a number of servers, and these nodes can have different roles if needed, even though the default is that all nodes have all roles. The cluster collectively manages indices and data just as you expect.

---

<div class="post-metadata">

**Author:** ![Mark\_Dendrix\_Garcia](https://avatars.discourse-cdn.com/v4/letter/m/8baadc/32.png) [@Mark\_Dendrix\_Garcia](https://discuss.elastic.co/u/Mark_Dendrix_Garcia)\
**Post date:** [July 24, 2018, 10:33am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/7 "2018-07-24T10:33:49Z")

</div>

And it doesn't use Zookeeper ? only ECE ?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 24, 2018, 10:34am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/8 "2018-07-24T10:34:31Z")

</div>

Yes, Elasticsearch does not use Zookeeper. Only ECE does.

---

<div class="post-metadata">

**Author:** ![Mark\_Dendrix\_Garcia](https://avatars.discourse-cdn.com/v4/letter/m/8baadc/32.png) [@Mark\_Dendrix\_Garcia](https://discuss.elastic.co/u/Mark_Dendrix_Garcia)\
**Post date:** [July 24, 2018, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/9 "2018-07-24T10:39:31Z")

</div>

I see, I can now safely assume that I can deploy on a MapR Cluster. Thus deploying elasticsearch application on every MapR Nodes or maybe a few nodes and safely run it. I really thought it uses a coordinator like zookeeper in order to monitor everything and produce a quorum.

Because we are going to develop a searching web application wherein you can search any documents inside the HDFS (mapr-fs for mapr) using elasticsearch as the solution for this. We got confuse on how should we deploy it (we are only new to elastic) since we see that It also has a cluster option and we got an idea that we can deploy it on every MapR nodes and hopefully to make it more faster and to keep a replication for all the data.

I now understand it, sorry for a confusing question. Thank you so much !

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 21, 2018, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-inside-mapr-cluster/141305/10 "2018-08-21T10:39:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
