Problems with a hadoop gateway


(Michael Rennecke) #1

Hello,
I will test/evaluate ElasticSearch with a hadoop gateway. I think
something is wrong in my configuration. I hope anybody can help me.

My configuration
...

Gateway Settings

gateway:

recover_after_nodes: 1

recover_after_time: 15m

expected_nodes: 2

type: hdfs
hdfs:
uri: hdfs://192.168.184.175:8200
path: elasticsearch

% bin/elasticsearch -f
[2011-07-20 09:56:17,070][INFO ][node ] [Omega the
Unknown] {elasticsearch/0.17.0}[5461]: initializing ...
[2011-07-20 09:56:17,077][INFO ][plugins ] [Omega the
Unknown] loaded [hadoop], sites []
[2011-07-20 09:56:18,629][ERROR][bootstrap ]
{elasticsearch/0.17.0}: Initialization Failed ...

  1. IOException[Call to /192.168.184.175:8200 failed on local
    exception: java.io.EOFException]

% tail -f logs/hadoop-rennecke-namenode-trantor.log
2011-07-20 09:56:18,577 WARN org.apache.hadoop.ipc.Server: Incorrect
header or version mismatch from 192.168.184.175:42556 got version 3
expected version 4
2011-07-20 09:56:18,628 WARN org.apache.hadoop.ipc.Server: Incorrect
header or version mismatch from 192.168.184.175:42557 got version 3
expected version 4

regards
Michael


(Shay Banon) #2

Which version of hadoop are you working with? The hadoop plugin comes with
0.20.2, but you can replace the jars if you want (have a look at the plugins
dir).

On Wed, Jul 20, 2011 at 10:59 AM, Michael Rennecke <
michael.rennecke@unister-gmbh.de> wrote:

Hello,
I will test/evaluate ElasticSearch with a hadoop gateway. I think
something is wrong in my configuration. I hope anybody can help me.

My configuration
...

Gateway Settings

gateway:

recover_after_nodes: 1

recover_after_time: 15m

expected_nodes: 2

type: hdfs
hdfs:
uri: hdfs://192.168.184.175:8200
path: elasticsearch

% bin/elasticsearch -f
[2011-07-20 09:56:17,070][INFO ][node ] [Omega the
Unknown] {elasticsearch/0.17.0}[5461]: initializing ...
[2011-07-20 09:56:17,077][INFO ][plugins ] [Omega the
Unknown] loaded [hadoop], sites []
[2011-07-20 09:56:18,629][ERROR][bootstrap ]
{elasticsearch/0.17.0}: Initialization Failed ...

  1. IOException[Call to /192.168.184.175:8200 failed on local
    exception: java.io.EOFException]

% tail -f logs/hadoop-rennecke-namenode-trantor.log
2011-07-20 09:56:18,577 WARN org.apache.hadoop.ipc.Server: Incorrect
header or version mismatch from 192.168.184.175:42556 got version 3
expected version 4
2011-07-20 09:56:18,628 WARN org.apache.hadoop.ipc.Server: Incorrect
header or version mismatch from 192.168.184.175:42557 got version 3
expected version 4

regards
Michael


(system) #3