Architecting a NodeJS backend that logs in ElasticSearch which is then used by Apache Spark/MLlib

Hi,

I'm wondering if it's possible to push from an existing NodeJS API to an
ElasticSearch server that is based on HDFS so that it can be used by Apache
Spark/MLlib.

The problem I'm encountering with Elasticsearch-Hadoop is that it is built
to run on the JVM (Java or Scala) but our entire infrastructure is in
Javascript. What is the best available way to connect these technologies?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/90479aeb-1144-4295-b0d1-3ad71407ef77%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

If you're running elasticsearch on YARN it's still just elasticsearch as
far as external tools are concerned so just use the regular node.js API to
talk to the cluster.

Also, I believe all the YARN integration does is allow you to easily
provision a ES cluster using YARN containers and I'm pretty sure that's not
even necessary to use ES with Spark it's just a convenience if you already
have a YARN cluster and want to provision and control elasticsearch within
that environment.

Kimbro Staken

On Mon, Apr 27, 2015 at 11:03 AM, Garrett Gottlieb <
garrett.gottlieb@gmail.com> wrote:

Hi,

I'm wondering if it's possible to push from an existing NodeJS API to an
ElasticSearch server that is based on HDFS so that it can be used by Apache
Spark/MLlib.

The problem I'm encountering with Elasticsearch-Hadoop is that it is built
to run on the JVM (Java or Scala) but our entire infrastructure is in
Javascript. What is the best available way to connect these technologies?

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/90479aeb-1144-4295-b0d1-3ad71407ef77%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/90479aeb-1144-4295-b0d1-3ad71407ef77%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAA0DmXYemtjhV8L%3DYVQwKdP8vtUY7Em%3D4G9zz-Lgw3gMgnTPkQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.