[hadoop] #<CompilerException org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Invalid configuration - No read or write resource specified,

Elastic Stack Elasticsearch
1

Hi,

I am trying to get a basic example with Apache Spark to read ES data into a
RDD. However, I am getting the following error:

#<CompilerException
org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Invalid
configuration - No read or write resource specified,

Any ideas? I am still not clear from the docs which params needs to be
passed to SparkConf to specify ES params.

Thanks,

Sébastien Arnaud

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/535f25ae-88ef-413a-b196-7ec8ce340f65%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

I'm not sure where the "Compiler Exception" comes from but I assume you are using the Map/Reduce layer instead of the
native integration with Spark.
If that is the case, see this section of the documentation [1]. One needs to set up the "es.resource" parameter.

Feel free to post a gist/snippet of your example for diagnostics.

[1] Elasticsearch Platform — Find real-time answers at scale | Elastic

On 10/5/14 4:58 AM, Sébastien Arnaud wrote:

Hi,

I am trying to get a basic example with Apache Spark to read ES data into a RDD. However, I am getting the following error:

#<CompilerException org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Invalid configuration - No read or write
resource specified,

Any ideas? I am still not clear from the docs which params needs to be passed to SparkConf to specify ES params.

Thanks,

Sébastien Arnaud

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/535f25ae-88ef-413a-b196-7ec8ce340f65%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/535f25ae-88ef-413a-b196-7ec8ce340f65%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout.
--
Costin

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/54310AE7.70106%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Thank you. It was what I was missing!

On Saturday, October 4, 2014 9:58:16 PM UTC-4, Sébastien Arnaud wrote:

Hi,

I am trying to get a basic example with Apache Spark to read ES data into
a RDD. However, I am getting the following error:

#<CompilerException
org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Invalid
configuration - No read or write resource specified,

Any ideas? I am still not clear from the docs which params needs to be
passed to SparkConf to specify ES params.

Thanks,

Sébastien Arnaud

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/813364df-fc37-4471-a7f7-e3869c917ec8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.