# How we can use es-hadoop in AWS EMR to connect external elasticsearch

**URL:** https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [November 17, 2017, 8:39am UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088 "2017-11-17T08:39:46Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![nand\_kishore](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nand_kishore/32/24371_2.png) [@nand\_kishore](https://discuss.elastic.co/u/nand_kishore)
#### Post date: [November 17, 2017, 8:39am UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088/1 "2017-11-17T08:39:46Z")

</div>

Dear all ,

I have AWS EMR and ELK stack installed on some other server. Since Hadoop is already installed in EMR so how can we connect with Elasticsearch. How much ES-Hadoop help us in AWS EMR. What configuration we need for it .

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [December 13, 2017, 5:57pm UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088/2 "2017-12-13T17:57:56Z")

</div>

Generally when running solutions in a cloud environment, it's best to make sure your clusters are accessible to each other on their private networks. This configuration is dependent on your cloud provider. ES-Hadoop allows you to set `es.nodes.wan.only` to disable any node discovery and filtering, which will power your job by sending and receiving data only though the cluster's gateway. Note that this solution can have detrimental effects on performance.

---

<div class="post-metadata">

### Author: ![nand\_kishore](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nand_kishore/32/24371_2.png) [@nand\_kishore](https://discuss.elastic.co/u/nand_kishore)
#### Post date: [December 14, 2017, 4:43am UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088/3 "2017-12-14T04:43:51Z")

</div>

Thanks, James., yes my ELK stack is also in AWS ec2 instances in private network. I need to connect with elastic search and get the data into EMR for processing. Does ES-Hadoop help me with this requirement?

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [December 14, 2017, 7:35pm UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088/4 "2017-12-14T19:35:51Z")

</div>

As mentioned above, there are two ways to access your data across cloud deployments:

1. Configure your deployments to allow access across their private networks. This must be configured in your cloud vendor's platform. ES-Hadoop cannot do this for you.
2. Use `es.nodes.wan.only` to pull and push data through the gateway for your cloud deployment of Elasticsearch.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 11, 2018, 7:36pm UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088/5 "2018-01-11T19:36:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
