# JavaEsSparkSQL incompatible with DataSet\<Row\>

**URL:** <https://discuss.elastic.co/t/javaessparksql-incompatible-with-dataset-row/135811>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [June 14, 2018, 12:05am UTC](https://discuss.elastic.co/t/javaessparksql-incompatible-with-dataset-row/135811 "2018-06-14T00:05:37Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![amogkam](https://avatars.discourse-cdn.com/v4/letter/a/5f8ce5/32.png) [@amogkam](https://discuss.elastic.co/u/amogkam)\
**Post date:** [June 14, 2018, 12:05am UTC](https://discuss.elastic.co/t/javaessparksql-incompatible-with-dataset-row/135811/1 "2018-06-14T00:05:37Z")

</div>

In Spark version 2.1, DataFrames are represented as DataSet in the Java API. However, the ES Spark SQL API still requires a type DataFrame in the saveToEs method. Is there any work around for this, or is there another method that can be used that supports DataSet?

---

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [June 21, 2018, 3:31pm UTC](https://discuss.elastic.co/t/javaessparksql-incompatible-with-dataset-row/135811/2 "2018-06-21T15:31:38Z")

</div>

Right now the ES-Hadoop integration for Spark SQL only supports Row objects. This is unlikely to change in the near future, as much of the serialization code is based on row objects combined with their schemas.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 19, 2018, 3:31pm UTC](https://discuss.elastic.co/t/javaessparksql-incompatible-with-dataset-row/135811/3 "2018-07-19T15:31:38Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
