How Hive connect to Elasticsearch when X-Pack installed

Elastic Stack Elasticsearch
1

Before i install the X-Pack,I execute the following in the Hive：

CREATE EXTERNAL TABLE T_TEMP_SALES_INFO(id string,loan_no string,str_no string) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.nodes' = '192.168.70.117:9200,192.168.70.122:9200,192.168.70.118:9200,192.168.70.119:9200,192.168.70.120:9200','es.resource'='temp_sales_info/type','es.read.metadata'='true','pushdown'='true','es.mapping.names'='id:_metadata._id,loan_no:loan_no,str_no:str_no');

The SQL will be OK.But After I install X-Pack,the SQL will report the error:

Error: org.apache.spark.sql.execution.QueryExecutionException: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only' (state=,code=0)

I want to know how to solve this!!!

2

Have you configured security for ES-Hadoop?

When you install X-Pack for Elasticsearch, it automatically enables user authentication for all connections. You need to instruct Hadoop/Hive to send a username/password (or PKI certificates) when connecting to ES.

3

I just specify 'es.username' and 'es.password',however,it report the same error.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.