Elasticsearch with Hadoop

Yes, it is call Gateway Local (basically your local filesystem)

On Thursday, May 10, 2012 4:30:36 PM UTC-5, Mo wrote:

Is there something that elasticsearch stores locally? I see we still need
to configure workdir.

On Thu, May 10, 2012 at 2:26 PM, Ivan Brusic ivan@brusic.com wrote:

HDFS will be the gateway for ES, storing both the index and metadata.

On Thu, May 10, 2012 at 2:20 PM, Mohit Anchlia mohitanchlia@gmail.com
wrote:

Looks like that plugin is to use it for backups? It's not clear if it
stores
all the data in HDFS.

On Thu, May 10, 2012 at 2:08 PM, Ivan Brusic ivan@brusic.com wrote:

I have never used it, but have you looked at the Hadoop plugin?

GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop

On Thu, May 10, 2012 at 7:21 AM, Mohit Anchlia <mohitanchlia@gmail.com

wrote:

We have a hadoop cluster and I would like to use HDFS as the storage
so
that
I have one place where everything is stored and tracked.

On Thu, May 10, 2012 at 1:02 AM, Jérome pivertjerome@gmail.com
wrote:

Aha, i follow this topic, have to do the same thing, you need it for
what exactly ?

On 10 mai, 01:18, Mohit Anchlia mohitanch...@gmail.com wrote:

Is anyone using elasticsearch with Hadoop? Would like to know how
it's
used
and any suggestions that you can provide would be helpful.

On Thursday, May 10, 2012 4:30:36 PM UTC-5, Mo wrote:

Is there something that elasticsearch stores locally? I see we still need
to configure workdir.

On Thu, May 10, 2012 at 2:26 PM, Ivan Brusic ivan@brusic.com wrote:

HDFS will be the gateway for ES, storing both the index and metadata.

On Thu, May 10, 2012 at 2:20 PM, Mohit Anchlia mohitanchlia@gmail.com
wrote:

Looks like that plugin is to use it for backups? It's not clear if it
stores
all the data in HDFS.

On Thu, May 10, 2012 at 2:08 PM, Ivan Brusic ivan@brusic.com wrote:

I have never used it, but have you looked at the Hadoop plugin?

GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop

On Thu, May 10, 2012 at 7:21 AM, Mohit Anchlia <mohitanchlia@gmail.com

wrote:

We have a hadoop cluster and I would like to use HDFS as the storage
so
that
I have one place where everything is stored and tracked.

On Thu, May 10, 2012 at 1:02 AM, Jérome pivertjerome@gmail.com
wrote:

Aha, i follow this topic, have to do the same thing, you need it for
what exactly ?

On 10 mai, 01:18, Mohit Anchlia mohitanch...@gmail.com wrote:

Is anyone using elasticsearch with Hadoop? Would like to know how
it's
used
and any suggestions that you can provide would be helpful.

On Thursday, May 10, 2012 4:30:36 PM UTC-5, Mo wrote:

Is there something that elasticsearch stores locally? I see we still need
to configure workdir.

On Thu, May 10, 2012 at 2:26 PM, Ivan Brusic ivan@brusic.com wrote:

HDFS will be the gateway for ES, storing both the index and metadata.

On Thu, May 10, 2012 at 2:20 PM, Mohit Anchlia mohitanchlia@gmail.com
wrote:

Looks like that plugin is to use it for backups? It's not clear if it
stores
all the data in HDFS.

On Thu, May 10, 2012 at 2:08 PM, Ivan Brusic ivan@brusic.com wrote:

I have never used it, but have you looked at the Hadoop plugin?

GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop

On Thu, May 10, 2012 at 7:21 AM, Mohit Anchlia <mohitanchlia@gmail.com

wrote:

We have a hadoop cluster and I would like to use HDFS as the storage
so
that
I have one place where everything is stored and tracked.

On Thu, May 10, 2012 at 1:02 AM, Jérome pivertjerome@gmail.com
wrote:

Aha, i follow this topic, have to do the same thing, you need it for
what exactly ?

On 10 mai, 01:18, Mohit Anchlia mohitanch...@gmail.com wrote:

Is anyone using elasticsearch with Hadoop? Would like to know how
it's
used
and any suggestions that you can provide would be helpful.

On Thursday, May 10, 2012 4:30:36 PM UTC-5, Mo wrote:

Is there something that elasticsearch stores locally? I see we still need
to configure workdir.

On Thu, May 10, 2012 at 2:26 PM, Ivan Brusic ivan@brusic.com wrote:

HDFS will be the gateway for ES, storing both the index and metadata.

On Thu, May 10, 2012 at 2:20 PM, Mohit Anchlia mohitanchlia@gmail.com
wrote:

Looks like that plugin is to use it for backups? It's not clear if it
stores
all the data in HDFS.

On Thu, May 10, 2012 at 2:08 PM, Ivan Brusic ivan@brusic.com wrote:

I have never used it, but have you looked at the Hadoop plugin?

GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop

On Thu, May 10, 2012 at 7:21 AM, Mohit Anchlia <mohitanchlia@gmail.com

wrote:

We have a hadoop cluster and I would like to use HDFS as the storage
so
that
I have one place where everything is stored and tracked.

On Thu, May 10, 2012 at 1:02 AM, Jérome pivertjerome@gmail.com
wrote:

Aha, i follow this topic, have to do the same thing, you need it for
what exactly ?

On 10 mai, 01:18, Mohit Anchlia mohitanch...@gmail.com wrote:

Is anyone using elasticsearch with Hadoop? Would like to know how
it's
used
and any suggestions that you can provide would be helpful.

On Thursday, May 10, 2012 4:30:36 PM UTC-5, Mo wrote:

Is there something that elasticsearch stores locally? I see we still need
to configure workdir.

On Thu, May 10, 2012 at 2:26 PM, Ivan Brusic ivan@brusic.com wrote:

HDFS will be the gateway for ES, storing both the index and metadata.

On Thu, May 10, 2012 at 2:20 PM, Mohit Anchlia mohitanchlia@gmail.com
wrote:

Looks like that plugin is to use it for backups? It's not clear if it
stores
all the data in HDFS.

On Thu, May 10, 2012 at 2:08 PM, Ivan Brusic ivan@brusic.com wrote:

I have never used it, but have you looked at the Hadoop plugin?

GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop

On Thu, May 10, 2012 at 7:21 AM, Mohit Anchlia <mohitanchlia@gmail.com

wrote:

We have a hadoop cluster and I would like to use HDFS as the storage
so
that
I have one place where everything is stored and tracked.

On Thu, May 10, 2012 at 1:02 AM, Jérome pivertjerome@gmail.com
wrote:

Aha, i follow this topic, have to do the same thing, you need it for
what exactly ?

On 10 mai, 01:18, Mohit Anchlia mohitanch...@gmail.com wrote:

Is anyone using elasticsearch with Hadoop? Would like to know how
it's
used
and any suggestions that you can provide would be helpful.