# Data from elasticsearch cluster to Azure HDInsight cluster

**URL:** <https://discuss.elastic.co/t/data-from-elasticsearch-cluster-to-azure-hdinsight-cluster/52023>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [June 7, 2016, 6:41am UTC](https://discuss.elastic.co/t/data-from-elasticsearch-cluster-to-azure-hdinsight-cluster/52023 "2016-06-07T06:41:19Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![bigben](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bigben/32/7981_2.png) [@bigben](https://discuss.elastic.co/u/bigben)\
**Post date:** [June 7, 2016, 6:41am UTC](https://discuss.elastic.co/t/data-from-elasticsearch-cluster-to-azure-hdinsight-cluster/52023/1 "2016-06-07T06:41:19Z")

</div>

I am trying to use hive to load data from my two nodes elasticsearch cluster to the Microsoft Azure Hadoop cluster called HDInsight.

I use \> curl 'localhost:9200/\_cat/master?v' to check my ES cluster master, assume that it is **192.168.0.48**

I start the Hive and ADD JAR /path/to/elasticsearch-hadoop-2.3.2.jar

I create an external table shown as follow and it is success.

`CREATE EXTERNAL TABLE test(time TIMESTAMP, host STRING, type STRING, message STRING ) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES( 'es.resource'='logstash-2016.06.07/syslog', 'es.nodes'='192.168.0.48', 'es.port'='9200', 'es.nodes.wan.only'='true' , 'es.mapping.names' = 'time:@timestamp , host:host , type:type , message:message');`

So far, everything is OK.

But when I use the ES-hadoop to load the data from elasticsearch cluster to Azure HDInsight, it has an error.

> Failed with exception java.io.IOException:org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'

I setup the es.nodes.wan.only to both true and false and always get this error.

Could someone give me any help？

---

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [June 9, 2016, 5:52pm UTC](https://discuss.elastic.co/t/data-from-elasticsearch-cluster-to-azure-hdinsight-cluster/52023/2 "2016-06-09T17:52:09Z")

</div>

Hello!

Setting the `es.nodes.wan.only` property to true just configures elasticsearch-hadoop to not do any further node discovery and to only use the provided `es.nodes` hosts for connections. It seems that your provided `es.nodes` IP is a private network IP. Are you able to normally reach the Elasticsearch node from one of the HDInsight nodes? For instance, if you replaced `localhost` with your given IP inside of the curl command, and then executed the command from a node in the HDInsight cluster, does it return anything?

Could you also paste a full stack trace if you have one? In some cases it can help highlight the issue when it's all present.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:24pm UTC](https://discuss.elastic.co/t/data-from-elasticsearch-cluster-to-azure-hdinsight-cluster/52023/3 "2017-07-06T13:24:25Z")

</div>