# Structured Streaming - "Failed to find data source: es"

**URL:** https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [December 18, 2017, 4:09am UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144 "2017-12-18T04:09:18Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![polomarcus](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/polomarcus/32/25733_2.png) [@polomarcus](https://discuss.elastic.co/u/polomarcus)
#### Post date: [December 18, 2017, 4:09am UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144/1 "2017-12-18T04:09:18Z")

</div>

Hi,

I am writing a code example for Structured streaming and elasticsearch-hadoop **6.1.0** and I encounter this error Failed to find data source: es. Would someone know why ?

`.format("es")`

My complete code example is available here :

> <https://github.com/polomarcus/Spark-Structured-Streaming-Examples/pull/12/files#diff-a7628744921de2c19011165c504f9fecR21>

Would "org.elasticsearch.spark.sql" be OK to use ?

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [December 18, 2017, 4:57pm UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144/2 "2017-12-18T16:57:12Z")

</div>

"org.elasticsearch.spark.sql" should be fine to use as well as "es". Can you share the stack trace that you are seeing? Are you sure that the correct jar is on the classpath?

---

<div class="post-metadata">

### Author: ![polomarcus](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/polomarcus/32/25733_2.png) [@polomarcus](https://discuss.elastic.co/u/polomarcus)
#### Post date: [December 19, 2017, 12:33am UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144/3 "2017-12-19T00:33:01Z")

</div>

Thanks for the quick answer.

```auto
java.lang.ClassNotFoundException: Failed to find data source: es. Please find packages at http://spark.apache.org/third-party-projects.html
	at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:549)
	at org.apache.spark.sql.execution.datasources.DataSource.providingClass$lzycompute(DataSource.scala:86)
	at org.apache.spark.sql.execution.datasources.DataSource.providingClass(DataSource.scala:86)
	at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:270)
	at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:286)
	at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:222)
	at elastic.ElasticSink$.writeStream(ElasticSink.scala:19)
	at main.Main$.main(Main.scala:24)
	at main.Main.main(Main.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
Caused by: java.lang.ClassNotFoundException: es.DefaultSource
	at java.lang.ClassLoader.findClass(ClassLoader.java:530)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

```

With this version used : `libraryDependencies += "org.elasticsearch" % "elasticsearch-hadoop" % "6.1.0"`

Just to be sure, what should be the imported class when we define our query ?

---

<div class="post-metadata">

### Author: ![polomarcus](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/polomarcus/32/25733_2.png) [@polomarcus](https://discuss.elastic.co/u/polomarcus)
#### Post date: [December 20, 2017, 4:46am UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144/4 "2017-12-20T04:46:52Z")

</div>

"org.elasticsearch.spark.sql" works fine 🧐  
But I'm still wondering why I am not able to use "es"

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 17, 2018, 4:47am UTC](https://discuss.elastic.co/t/structured-streaming-failed-to-find-data-source-es/112144/5 "2018-01-17T04:47:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.