What is the best way to include a class path that points to a JAR file when
using the spark shell (specifically when running spark shell from the
master of a multi slave master/slave cluster)?
Or more specifically, the elasticsearch-hadoop jar
compiled jar download:
http://www.elasticsearch.org/overview/hadoop/download/
more info:
http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/spark.html
elasticsearch-hadoop needs to be available in Spark’s classpath. As Spark
has multiple deployment modes, this can translate to the target classpath,
whether it is on only one node (as is the case with the local mode - which
will be used through-out the documentation) or per-node depending on the
desired infrastructure.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b3cbb994-eb52-4a76-840f-fbeadc8e0682%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Also - does the elasticsearch-hadoop JAR need to be on all slave nodes too?
On Friday, October 17, 2014 8:20:46 AM UTC-7, Jeff Steinmetz wrote:
What is the best way to include a class path that points to a JAR file
when using the spark shell (specifically when running spark shell from the
master of a multi slave master/slave cluster)?
Or more specifically, the elasticsearch-hadoop jar
compiled jar download:
Elasticsearch Platform — Find real-time answers at scale | Elastic
more info:
Elasticsearch Platform — Find real-time answers at scale | Elastic
elasticsearch-hadoop needs to be available in Spark’s classpath. As Spark
has multiple deployment modes, this can translate to the target classpath,
whether it is on only one node (as is the case with the local mode - which
will be used through-out the documentation) or per-node depending on the
desired infrastructure.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4c15d56-d8fb-4da6-a361-3a729baf7040%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.