# Cannot read from Elasticsearch using Spark SQL

**URL:** <https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318>\
**Category:** Elasticsearch\
**Created:** [April 20, 2015, 10:17am UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318 "2015-04-20T10:17:53Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![michele\_crudele](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@michele\_crudele](https://discuss.elastic.co/u/michele_crudele)\
**Post date:** [April 20, 2015, 10:17am UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318/1 "2015-04-20T10:17:53Z")

</div>

I wrote this simple notebook in scala using Elasticsearch Spark adapter:

%AddJar  
file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-spark\_2.10-2.1.0.BUILD-SNAPSHOT.jar  
%AddJar  
file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-hadoop-2.1.0.BUILD-SNAPSHOT.jar

// Write something to spark/docs index  
//  
import org.elasticsearch.spark.\_

val michelangelo = Map("artist" -\> "Michelangelo", "bio" -\> "Painter,  
sculptor, architect born in Florence in... ")  
val leonardo = Map("artist" -\> "Leonardo", "bio" -\> "Absolute genius;  
painter, inventor born in the little village of Vinci...")

sc.makeRDD(Seq(michelangelo, leonardo)).saveToEs("spark/docs")

// Search for painters through spark/docs  
//  
val painters = sc.esRDD("spark/docs", "?q=painter")  
println("Number of painters in spark/docs: " + painters.count())

painters.collect().foreach(x =\> println("ID: " + x.\_1))

// Try to read using SparkSQL  
//  
import org.apache.spark.sql.SQLContext  
import org.elasticsearch.spark.\_  
import org.elasticsearch.spark.sql.\_

val sql = new SQLContext(sc)

// Here is where I get an exception  
//  
val docsSql = sql.esRDD("spark/docs")

Name: java.lang.NoSuchMethodError  
Message:  
org.apache.spark.sql.catalyst.types.StructField.(Ljava/lang/String;Lorg/apache/spark/sql/catalyst/types/DataType;Z)V  
StackTrace:  
org.elasticsearch.spark.sql.MappingUtils$.org$elasticsearch$spark$sql$MappingUtils$$convertField(MappingUtils.scala:75)  
org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)  
org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)  
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)  
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)  
scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)  
scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)  
scala.collection.TraversableLike$class.map(TraversableLike.scala:244)  
scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:108)  
org.elasticsearch.spark.sql.MappingUtils$.convertToStruct(MappingUtils.scala:54)  
org.elasticsearch.spark.sql.MappingUtils$.discoverMapping(MappingUtils.scala:47)  
org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:27)  
org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:23)  
org.elasticsearch.spark.sql.package$SQLContextFunctions.esRDD(package.scala:16)  
$line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$$$$$c57ec8bf9b0d5f6161b97741d596ff0$$$$wC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:111)  
$line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:116)  
$line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:118)  
$line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$

What am I doing wrong? Thanks

- Michele

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [April 20, 2015, 10:38am UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318/2 "2015-04-20T10:38:08Z")

</div>

Beta3 work with Spark SQL 1.0 and 1.1  
Spark SQL 1.2 was released after that and broke binary backwards compatibility however his has been fixed in master/dev  
version [1]  
Note that Spark SQL 1.3 was released as well and again, broke backwards compatibility this time significant hence why  
there are now two versions [2] - make sure to use the one appropriate for your Spark version.

Cheers,

[1] [Installation | Elasticsearch for Apache Hadoop [master] | Elastic](http://www.elastic.co/guide/en/elasticsearch/hadoop/master/install.html#download-dev)  
[2] [Apache Spark support | Elasticsearch for Apache Hadoop [master] | Elastic](http://www.elastic.co/guide/en/elasticsearch/hadoop/master/spark.html#spark-sql-versions)

On 4/20/15 1:17 PM, michele crudele wrote:

> I wrote this simple notebook in scala using Elasticsearch Spark adapter:
> 
> %AddJar file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-spark\_2.10-2.1.0.BUILD-SNAPSHOT.jar  
> %AddJar file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-hadoop-2.1.0.BUILD-SNAPSHOT.jar
> 
> // Write something to spark/docs index  
> //  
> import org.elasticsearch.spark.\_
> 
> val michelangelo = Map("artist" -\> "Michelangelo", "bio" -\> "Painter, sculptor, architect born in Florence in... ")  
> val leonardo = Map("artist" -\> "Leonardo", "bio" -\> "Absolute genius; painter, inventor born in the little village of  
> Vinci...")
> 
> sc.makeRDD(Seq(michelangelo, leonardo)).saveToEs("spark/docs")
> 
> // Search for painters through spark/docs  
> //  
> val painters = sc.esRDD("spark/docs", "?q=painter")  
> println("Number of painters in spark/docs: " + painters.count())
> 
> painters.collect().foreach(x =\> println("ID: " + x.\_1))
> 
> // Try to read using SparkSQL  
> //  
> import org.apache.spark.sql.SQLContext  
> import org.elasticsearch.spark.\_  
> import org.elasticsearch.spark.sql.\_
> 
> val sql = new SQLContext(sc)
> 
> // Here is where I get an exception  
> //  
> val docsSql = sql.esRDD("spark/docs")
> 
> Name: java.lang.NoSuchMethodError  
> Message:  
> org.apache.spark.sql.catalyst.types.StructField.(Ljava/lang/String;Lorg/apache/spark/sql/catalyst/types/DataType;Z)V  
> StackTrace:  
> org.elasticsearch.spark.sql.MappingUtils$.org$elasticsearch$spark$sql$MappingUtils$$convertField(MappingUtils.scala:75)  
> org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)  
> org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)  
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)  
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)  
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)  
> scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)  
> scala.collection.TraversableLike$class.map(TraversableLike.scala:244)  
> scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:108)  
> org.elasticsearch.spark.sql.MappingUtils$.convertToStruct(MappingUtils.scala:54)  
> org.elasticsearch.spark.sql.MappingUtils$.discoverMapping(MappingUtils.scala:47)  
> org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:27)  
> org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:23)  
> org.elasticsearch.spark.sql.package$SQLContextFunctions.esRDD(package.scala:16)  
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$$$$$c57ec8bf9b0d5f6161b97741d596ff0$$$$wC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:111)  
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:116)  
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:118)  
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$
> 
> What am I doing wrong? Thanks
> 
> - Michele
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5534D710.3020402%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/5534D710.3020402%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![michele\_crudele](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@michele\_crudele](https://discuss.elastic.co/u/michele_crudele)\
**Post date:** [April 23, 2015, 7:39am UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318/3 "2015-04-23T07:39:52Z")

</div>

Thanks Costin.

Il giorno lunedì 20 aprile 2015 12:38:30 UTC+2, Costin Leau ha scritto:

> Beta3 work with Spark SQL 1.0 and 1.1  
> Spark SQL 1.2 was released after that and broke binary backwards  
> compatibility however his has been fixed in master/dev  
> version [1]  
> Note that Spark SQL 1.3 was released as well and again, broke backwards  
> compatibility this time significant hence why  
> there are now two versions [2] - make sure to use the one appropriate for  
> your Spark version.
> 
> Cheers,
> 
> [1]  
> [Installation | Elasticsearch for Apache Hadoop [master] | Elastic](http://www.elastic.co/guide/en/elasticsearch/hadoop/master/install.html#download-dev)  
> [2]  
> [Apache Spark support | Elasticsearch for Apache Hadoop [master] | Elastic](http://www.elastic.co/guide/en/elasticsearch/hadoop/master/spark.html#spark-sql-versions)
> 
> On 4/20/15 1:17 PM, michele crudele wrote:
> 
> > I wrote this simple notebook in scala using Elasticsearch Spark adapter:
> > 
> > %AddJar  
> > file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-spark\_2.10-2.1.0.BUILD-SNAPSHOT.jar
> 
> > %AddJar  
> > file:///tools/elasticsearch-hadoop-2.1.0.Beta3/dist/elasticsearch-hadoop-2.1.0.BUILD-SNAPSHOT.jar
> 
> > // Write something to spark/docs index  
> > //  
> > import org.elasticsearch.spark.\_
> > 
> > val michelangelo = Map("artist" -\> "Michelangelo", "bio" -\> "Painter,  
> > sculptor, architect born in Florence in... ")  
> > val leonardo = Map("artist" -\> "Leonardo", "bio" -\> "Absolute genius;  
> > painter, inventor born in the little village of  
> > Vinci...")
> > 
> > sc.makeRDD(Seq(michelangelo, leonardo)).saveToEs("spark/docs")
> > 
> > // Search for painters through spark/docs  
> > //  
> > val painters = sc.esRDD("spark/docs", "?q=painter")  
> > println("Number of painters in spark/docs: " + painters.count())
> > 
> > painters.collect().foreach(x =\> println("ID: " + x.\_1))
> > 
> > // Try to read using SparkSQL  
> > //  
> > import org.apache.spark.sql.SQLContext  
> > import org.elasticsearch.spark.\_  
> > import org.elasticsearch.spark.sql.\_
> > 
> > val sql = new SQLContext(sc)
> > 
> > // Here is where I get an exception  
> > //  
> > val docsSql = sql.esRDD("spark/docs")
> > 
> > Name: java.lang.NoSuchMethodError  
> > Message:
> 
> org.apache.spark.sql.catalyst.types.StructField.(Ljava/lang/String;Lorg/apache/spark/sql/catalyst/types/DataType;Z)V
> 
> > StackTrace:
> 
> org.elasticsearch.spark.sql.MappingUtils$.org$elasticsearch$spark$sql$MappingUtils$$convertField(MappingUtils.scala:75)
> 
> > 
> 
> org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)
> 
> > 
> 
> org.elasticsearch.spark.sql.MappingUtils$$anonfun$convertToStruct$1.apply(MappingUtils.scala:54)
> 
> > 
> 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> 
> > 
> 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> 
> > 
> 
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> 
> > scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)  
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:244)  
> > scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:108)
> 
> org.elasticsearch.spark.sql.MappingUtils$.convertToStruct(MappingUtils.scala:54)
> 
> > 
> 
> org.elasticsearch.spark.sql.MappingUtils$.discoverMapping(MappingUtils.scala:47)
> 
> > org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:27)  
> > org.elasticsearch.spark.sql.EsSparkSQL$.esRDD(EsSparkSQL.scala:23)
> 
> org.elasticsearch.spark.sql.package$SQLContextFunctions.esRDD(package.scala:16)
> 
> > 
> 
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$$$$$c57ec8bf9b0d5f6161b97741d596ff0$$$$wC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:111)
> 
> > 
> 
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:116)
> 
> > 
> 
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.(:118)
> 
> > 
> 
> $line460.$read$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$
> 
> > What am I doing wrong? Thanks
> > 
> > - Michele
> > 
> > --  
> > You received this message because you are subscribed to the Google  
> > Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send  
> > an email to  
> > [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\> \<mailto:  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<javascript:\>\>.  
> > To view this discussion on the web visit
> 
> [https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com)
> 
> > \<  
> > [https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/49a5c624-bda0-4835-98bc-915ec80d4fa3%40googlegroups.com?utm_medium=email&utm_source=footer)\>.
> 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fbbc4fc9-6662-4d57-b189-cbf8c60f36af%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fbbc4fc9-6662-4d57-b189-cbf8c60f36af%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ebuildy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ebuildy/32/6070_2.png) [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Post date:** [October 10, 2016, 11:23am UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318/4 "2016-10-10T11:23:18Z")

</div>

Please Justin, put a simple HTML table in documentation with compatibilities matrix between Hadoop / Spark / elasticsearch-hadoop / elasticsearch !

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:13pm UTC](https://discuss.elastic.co/t/cannot-read-from-elasticsearch-using-spark-sql/23318/5 "2017-07-05T22:13:37Z")

</div>