Connecting Spark to ES

I am getting the following exception while attempting to read from ES (elasticsearch-5.2.0) into Spark (spark-2.1.0-bin-hadoop2.7) on the local host using ES-to-Hadoop (elasticsearch-hadoop-5.1.2.jar):
"Cannot find node with id". The single ES master/data node is up (see below). What might cause the problem?

curl -XGET localhost:9200/_nodes/http

@yurik Could you please post the full stack trace as well as any logs from the run, and your configuration settings?

The following solves the problem:
./spark-shell --jars /elasticsearch-hadoop-5.2.0.jar --conf"localhost"

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.