# Spark streaming elasticsearch dependencies **URL:** \ **Category:** Elasticsearch\ **Created:** [November 19, 2014, 11:15am UTC](https://discuss.elastic.co/t/spark-streaming-elasticsearch-dependencies/20834 "2014-11-19T11:15:49Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![Mohamed\_Hedi\_ABIDI](https://avatars.discourse-cdn.com/v4/letter/m/35a633/32.png) [@Mohamed\_Hedi\_ABIDI](https://discuss.elastic.co/u/Mohamed_Hedi_ABIDI)\ **Post date:** [November 19, 2014, 11:15am UTC](https://discuss.elastic.co/t/spark-streaming-elasticsearch-dependencies/20834/1 "2014-11-19T11:15:49Z")
Im trying Spark & Elasticsearch integration in scala as described in Elasticsearch Guide [http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/master/spark.html](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/master/spark.html) I have problems with dependencies when compiling : [trace] Stack trace suppressed: run last _:update for the full output.[error] (_:update) sbt.ResolveException: unresolved dependency: cascading#ing-local;2.5.6: not found[error] unresolved dependency: clj-time#clj-time;0.4.1: not found[error] unresolved dependency: compojure#compojure;1.1.3: not found[error] unresolved dependency: hiccup#hiccup;0.3.6: not found[error] unresolved dependency: ring#ring-devel;0.3.11: not found[error] unresolved dependency: ring#ring-jetty-adapter;0.3.11: not found[error] unresolved dependency: com.twitter#carbonite;1.4.0: not found[error] unresolved dependency: cascading#cascading-hadoop;2.5.6: not found[error] Total time: 86 s, completed 19 nov. 2014 08:42:58 My build.sbt file look like this name := "twitter-sparkstreaming-elasticsearch" version := "0.0.1" scalaVersion := "2.10.4" // additional libraries libraryDependencies ++= Seq( "org.apache.spark" %% "spark-core" % "1.1.0", "org.apache.spark" %% "spark-streaming" % "1.1.0", "org.apache.spark" %% "spark-streaming-twitter" % "1.1.0", "org.elasticsearch" % "elasticsearch-hadoop" % "2.1.0") Help? thanks. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/11105bb6-2148-4eef-bc43-d2b3fcc16f12%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/11105bb6-2148-4eef-bc43-d2b3fcc16f12%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [November 19, 2014, 12:58pm UTC](https://discuss.elastic.co/t/spark-streaming-elasticsearch-dependencies/20834/2 "2014-11-19T12:58:15Z")
Cascading and its dependencies are not available in Maven central but in their own repo (which es-hadoop cannot specify through its pom). However since you are not using cascasding but rather spark, I suggest you use the dedicated jar for that, namely: elasticsearch-spark\_2.10 > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. On 11/19/14, Mohamed Hedi ABIDI [abidimh@gmail.com](mailto:abidimh@gmail.com) wrote: > Im trying Spark & Elasticsearch integration in scala as described in > Elasticsearch > Guide > [http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/master/spark.html](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/master/spark.html) > > I have problems with dependencies when compiling : > > [trace] Stack trace suppressed: run last _:update for the full > output.[error] (_:update) sbt.ResolveException: unresolved dependency: > cascading#ing-local;2.5.6: not found[error] unresolved dependency: > clj-time#clj-time;0.4.1: not found[error] unresolved dependency: > compojure#compojure;1.1.3: not found[error] unresolved dependency: > hiccup#hiccup;0.3.6: not found[error] unresolved dependency: > ring#ring-devel;0.3.11: not found[error] unresolved dependency: > ring#ring-jetty-adapter;0.3.11: not found[error] unresolved dependency: > com.twitter#carbonite;1.4.0: not found[error] unresolved dependency: > cascading#cascading-hadoop;2.5.6: not found[error] Total time: 86 s, > completed 19 nov. 2014 08:42:58 > > My build.sbt file look like this > > name := "twitter-sparkstreaming-elasticsearch" > > version := "0.0.1" > > scalaVersion := "2.10.4" > // additional libraries > libraryDependencies ++= Seq( > "org.apache.spark" %% "spark-core" % "1.1.0", > "org.apache.spark" %% "spark-streaming" % "1.1.0", > "org.apache.spark" %% "spark-streaming-twitter" % "1.1.0", > "org.elasticsearch" % "elasticsearch-hadoop" % "2.1.0") > > Help? thanks. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/11105bb6-2148-4eef-bc43-d2b3fcc16f12%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/11105bb6-2148-4eef-bc43-d2b3fcc16f12%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAJogdmfe8bFtm\_ZDR5QrUv5nOPOsbAeoqEL44xkPGL3kW6u85Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAJogdmfe8bFtm_ZDR5QrUv5nOPOsbAeoqEL44xkPGL3kW6u85Q%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:49am UTC](https://discuss.elastic.co/t/spark-streaming-elasticsearch-dependencies/20834/3 "2017-07-06T00:49:00Z")