# ES(ECE 2.2) - HADOOP Connectivity **URL:** \ **Category:** Elasticsearch\ **Tags:** es-hadoop\ **Created:** [August 8, 2019, 3:08pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461 "2019-08-08T15:08:33Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![rijash](https://avatars.discourse-cdn.com/v4/letter/r/c2a13f/32.png) [@rijash](https://discuss.elastic.co/u/rijash)\ **Post date:** [August 8, 2019, 3:08pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461/1 "2019-08-08T15:08:33Z")
Hi, I am getting the below error while trying to ingest data to ES (ECE) from hadoop (HIVE) query. =============== 2019-08-08 13:55:24,957 INFO [main]: httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(444)) - Retrying request 2019-08-08 13:55:24,958 ERROR [main]: rest.NetworkClient (NetworkClient.java:execute(147)) - Node [[d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com](http://d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com/):443] failed (java.net.ConnectException: Connection refused (Connection refused)); no other nodes left - aborting... 2019-08-08 13:55:24,959 ERROR [main]: CliDriver (SessionState.java:printError(1089)) - Failed with exception java.io.IOException:org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only' java.io.IOException: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only' ``` at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:520) at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:427) at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146) at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1773) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:237) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:169) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:380) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:740) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:685) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) ``` Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only' ``` at org.elasticsearch.hadoop.rest.InitializationUtils.discoverClusterInfo(InitializationUtils.java:340) at org.elasticsearch.hadoop.hive.HiveUtils.init(HiveUtils.java:197) at org.elasticsearch.hadoop.hive.EsHiveInputFormat.getSplits(EsHiveInputFormat.java:112) at org.elasticsearch.hadoop.hive.EsHiveInputFormat.getSplits(EsHiveInputFormat.java:51) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:371) at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:303) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:458) ... 15 more ``` Caused by: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection error (check network and/or proxy settings)- all nodes failed; tried [[[d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com](http://d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com/):443]] ``` at org.elasticsearch.hadoop.rest.NetworkClient.execute(NetworkClient.java:152) at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:424) at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:388) at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:392) at org.elasticsearch.hadoop.rest.RestClient.get(RestClient.java:168) at org.elasticsearch.hadoop.rest.RestClient.mainInfo(RestClient.java:735) at org.elasticsearch.hadoop.rest.InitializationUtils.discoverClusterInfo(InitializationUtils.java:330) ... 21 more ``` 2019-08-08 13:55:24,959 INFO [main]: exec.TableScanOperator (Operator.java:close(616)) - Closing operator TS[0] 2019-08-08 13:55:24,959 INFO [main]: exec.SelectOperator (Operator.java:close(616)) - Closing operator SEL[1] 2019-08-08 13:55:24,959 INFO [main]: exec.ListSinkOperator (Operator.java:close(616)) - Closing operator OP[3] 2019-08-08 13:55:24,963 INFO [main]: CliDriver (SessionState.java:printInfo(1066)) - Time taken: 0.051 seconds 2019-08-08 13:55:24,963 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(149)) - # 2019-08-08 13:55:24,963 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(177)) - \ Below configuration is working fine for ES as independent component but failing in ECE. # ==================== 'es.index.read.missing.as.empty'='true', 'es.mapping.date.rich'='false', 'es.mapping.names'='date:@timestamp', 'es.net.http.auth.pass'='\', 'es.net.http.auth.user'='\', 'es.net.ssl'='true', 'es.net.ssl.cert.allow.self.signed'='true', 'es.net.ssl.keystore.location'='file:///etc/ssl/certs/1.jks', 'es.net.ssl.keystore.pass'='\', 'es.net.ssl.keystore.type'='jks', 'es.net.ssl.protocol'='SSL', 'es.nodes.wan.only'='true', 'es.nodes'='[d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com:443](http://d985e2b66da74bd1860a09a9347c3506.elkeu.ondemand.com:443)', 'es.query'='?q=\*', 'es.resource'='users/user-events' ---
**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\ **Post date:** [August 14, 2019, 7:20pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461/2 "2019-08-14T19:20:07Z")
Can you increase the logging level on Hive and Hadoop for just the `org.elasticsearch.hadoop.rest.commonshttp` package to `TRACE` and post the output here? There seems to be an issue with the initial request from ES-Hadoop to the ES cluster failing to complete. ---
**Author:** ![rijash](https://avatars.discourse-cdn.com/v4/letter/r/c2a13f/32.png) [@rijash](https://discuss.elastic.co/u/rijash)\ **Post date:** [August 14, 2019, 8:58pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461/3 "2019-08-14T20:58:28Z")
Hi James, Thanks for your response. I have fixed the issue by configuring below in the table properties. **'es.index.read.missing.as.empty'='true',** **'es.mapping.date.rich'='false',** **'es.mapping.names'='date:@timestamp',** **'es.net.http.auth.pass'='\',** **'es.net.http.auth.user'='\',** **'es.net.ssl'='true',** **'es.net.ssl.cert.allow.self.signed'='true',** **'es.net.ssl.keystore.location'='\',** **'es.net.ssl.keystore.pass'='\',** **'es.net.ssl.keystore.type'='jks',** **'es.net.ssl.truststore.location'='\',** **'es.net.ssl.truststore.pass'='\',** **'es.net.ssl.truststore.type'='jks',** **'es.net.ssl.protocol'='SSL',** **'es.nodes.wan.only'='true',** **'es.nodes'='\:9243',** **'es.query'='?q=\*',** **'es.resource'='\/\'** Regards, Rijash ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 11, 2019, 8:58pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461/4 "2019-09-11T20:58:31Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.