I'm trying to insert data into elasticsearch from pig. I can insert into ES
on the same node as Pig just fine, but when I try to insert it into ES on
another node, I'm running into errors. I'm using the following command -
STORE result INTO 'medi/hps_with_prev' USING
org.elasticsearch.hadoop.pig.EsStorage ('es.http.timeout = 5m',
'es.index.auto.create = true', 'es.nodes=es-name:9210');
My cluster and node name is 'es-name' and http port is 9210. I'm running
into the following error -
Can anyone help me on this? How do I specify the settings in
elasticsearch-hadoop when ES node and Hadoop node are not co-located?
On Thursday, July 24, 2014 10:34:43 AM UTC-7, ashish jain wrote:
Hi,
I'm trying to insert data into elasticsearch from pig. I can insert into
ES on the same node as Pig just fine, but when I try to insert it into ES
on another node, I'm running into errors. I'm using the following command -
STORE result INTO 'medi/hps_with_prev' USING
org.elasticsearch.hadoop.pig.EsStorage ('es.http.timeout = 5m',
'es.index.auto.create = true', 'es.nodes=es-name:9210');
My cluster and node name is 'es-name' and http port is 9210. I'm running
into the following error -
You need to specify the nodes IP not cluster name. In other words, take
some nodes (you don't need all) from your Elasticsearch cluster, identify
their IP and port and specify those within es.nodes. You can also use host
names but in general, IPs are recommended since they tend to last longer
(and avoids misconfigured DNSs).
So your es.nodes would look something like: 10.0.0.1, 192.168.1.1, etc....
Cheers,
On Monday, July 28, 2014 9:52:06 PM UTC+3, ashish jain wrote:
Can anyone help me on this? How do I specify the settings in
elasticsearch-hadoop when ES node and Hadoop node are not co-located?
On Thursday, July 24, 2014 10:34:43 AM UTC-7, ashish jain wrote:
Hi,
I'm trying to insert data into elasticsearch from pig. I can insert into
ES on the same node as Pig just fine, but when I try to insert it into ES
on another node, I'm running into errors. I'm using the following command -
STORE result INTO 'medi/hps_with_prev' USING
org.elasticsearch.hadoop.pig.EsStorage ('es.http.timeout = 5m',
'es.index.auto.create = true', 'es.nodes=es-name:9210');
My cluster and node name is 'es-name' and http port is 9210. I'm running
into the following error -
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.