# Does Elastic Search Spark 6.1.2 connector has Spark streaming sink?

**URL:** <https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [January 23, 2018, 8:07pm UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748 "2018-01-23T20:07:33Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![kant\_kodali](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kant_kodali/32/50637_2.png) [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\
**Post date:** [January 23, 2018, 8:07pm UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748/1 "2018-01-23T20:07:33Z")

</div>

Does Elastic Search Spark 6.1.2 connector has Spark streaming sink?

I am using `compile group: 'org.elasticsearch', name: 'elasticsearch-hadoop', version: '6.1.2'`

For example I tried the following and both didn't work.

Example #1

```
              df
                .writeStream()
                .outputMode("update")
                .trigger(Trigger.ProcessingTime(1000))
                .format("es")
                .option("checkpointLocation", "/tmp")
                .start("test/hello");

java.lang.ClassNotFoundException: Failed to find data source: es. Please find packages at http://spark.apache.org/third-party-projects.html

```

Example #2

```
              df
                .writeStream()
                .outputMode("update")
                .trigger(Trigger.ProcessingTime(1000))
                .format("org.elasticsearch.spark.sql.streaming.EsSparkSqlStreamingSink")
                .option("checkpointLocation", "/tmp")
                .start("test/hello");

java.lang.InstantiationException: org.elasticsearch.spark.sql.streaming.EsSparkSqlStreamingSink
Caused by: java.lang.NoSuchMethodException: org.elasticsearch.spark.sql.streaming.EsSparkSqlStreamingSink.<init>()
```

---

<div class="post-metadata">

**Author:** ![kant\_kodali](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kant_kodali/32/50637_2.png) [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\
**Post date:** [January 23, 2018, 8:24pm UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748/2 "2018-01-23T20:24:34Z")

</div>

Did some trial and error and Looks like the below fixes the problem.

```
     df
        .writeStream()
        .outputMode("append")
        .trigger(Trigger.ProcessingTime(1000))
        .format("org.elasticsearch.spark.sql")
        .option("checkpointLocation", "/tmp")
        .start("test/hello");
```

---

<div class="post-metadata">

**Author:** ![BicaLuv](https://avatars.discourse-cdn.com/v4/letter/b/c5a1d2/32.png) [@BicaLuv](https://discuss.elastic.co/u/BicaLuv)\
**Post date:** [January 24, 2018, 5:51am UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748/3 "2018-01-24T05:51:23Z")

</div>

I can confirm that you have to specify the streaming class as “org.elasticsearch.spark.sql”.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 21, 2018, 5:52am UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748/4 "2018-02-21T05:52:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.