Help on using Elastic Search Api from SPark

Elastic Stack Elasticsearch
1

Hi ,

I am trying to use Elastic Search Rest Api for searching Elastic
Search Index from Spark Code in Scala. I tried wabisabi and
searchboxio . For some reason I am not able to import the classes even
though I added the packages in my pom . I am using Spark 1.3.0. Is
there any other package I can use to do search on each row using Rest
api from Spark code ?

Thanks,
Deepak Subhramanian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BUubijggRS-9DNRziZ%2BSqGKUu-i4kN3gaDn78s2TYePycX3wA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

2

Take a look at Elasticsearch Hadoop project [1]. It features
integration with various Hadoop libraries including Apache Spark [2].

Cheers,

[1] Elasticsearch for Hadoop | Elastic
[2] Apache Spark support | Elasticsearch for Apache Hadoop [8.11] | Elastic

On Thu, Apr 30, 2015 at 8:36 PM, Deepak Subhramanian
deepak.subhramanian@gmail.com wrote:

Hi ,

I am trying to use Elastic Search Rest Api for searching Elastic
Search Index from Spark Code in Scala. I tried wabisabi and
searchboxio . For some reason I am not able to import the classes even
though I added the packages in my pom . I am using Spark 1.3.0. Is
there any other package I can use to do search on each row using Rest
api from Spark code ?

Thanks,
Deepak Subhramanian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BUubijggRS-9DNRziZ%2BSqGKUu-i4kN3gaDn78s2TYePycX3wA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJogdmffvyLbxbqJJ7DQQQ7KKVa9pJEtXgAHfTut%3D_1vgjrp5A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

It looks like it is related to an intellij maven import issue as it is
not downloading any new dependency I am adding.

On Thu, Apr 30, 2015 at 6:36 PM, Deepak Subhramanian
deepak.subhramanian@gmail.com wrote:

Hi ,

I am trying to use Elastic Search Rest Api for searching Elastic
Search Index from Spark Code in Scala. I tried wabisabi and
searchboxio . For some reason I am not able to import the classes even
though I added the packages in my pom . I am using Spark 1.3.0. Is
there any other package I can use to do search on each row using Rest
api from Spark code ?

Thanks,
Deepak Subhramanian

--
Deepak Subhramanian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BUubigxXt-n4P5QvRWRFQwdYZG559FzvPRnSeJpDHUhgE2Q5w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

4

"It looks like it is related to an intellij maven import issue as it is
not downloading any new dependency I am adding."

Pardon? I don't understand what you are saying. Are we talking about
the same project? Have you looked at the docs I mentioned?
In particular [1] the install page?

I ask since:

  • the connector is a jar that you can just install/download and add to
    your classpath. It works standalone and doesn't require anything else
  • it is NOT a maven plugin
  • even if you are trying to build the project, it does not use maven
    but rather Gradle
  • the connector doesn't download anything for you. Least a
    "dependency" that you are adding.

[1] http://www.elastic.co/guide/en/elasticsearch/hadoop/2.1.Beta/install.html

On Fri, May 1, 2015 at 1:36 AM, Deepak Subhramanian
deepak.subhramanian@gmail.com wrote:

It looks like it is related to an intellij maven import issue as it is
not downloading any new dependency I am adding.

On Thu, Apr 30, 2015 at 6:36 PM, Deepak Subhramanian
deepak.subhramanian@gmail.com wrote:

Hi ,

I am trying to use Elastic Search Rest Api for searching Elastic
Search Index from Spark Code in Scala. I tried wabisabi and
searchboxio . For some reason I am not able to import the classes even
though I added the packages in my pom . I am using Spark 1.3.0. Is
there any other package I can use to do search on each row using Rest
api from Spark code ?

Thanks,
Deepak Subhramanian

--
Deepak Subhramanian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BUubigxXt-n4P5QvRWRFQwdYZG559FzvPRnSeJpDHUhgE2Q5w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJogdmeBjnfBnik4200LxY%3DWbgdyUQQmdmrG_XzwxL3SkNiQCA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.