In Spark version 2.1, DataFrames are represented as DataSet in the Java API. However, the ES Spark SQL API still requires a type DataFrame in the saveToEs method. Is there any work around for this, or is there another method that can be used that supports DataSet?
Right now the ES-Hadoop integration for Spark SQL only supports Row objects. This is unlikely to change in the near future, as much of the serialization code is based on row objects combined with their schemas.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.