Xml files and HDFS

Elastic Stack Elasticsearch
1

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch? Convert
    it to JSON?
  2. Does elasticsearch integrate with hadoop HDFS?
2

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch?
    Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?

3

You could also use the attachment plugin but with some overhead on ES side instead of overhead on your side.

David :wink:
Twitter : @dadoonet / @elasticsearchfr

Le 10 mai 2012 à 07:53, Shay Banon kimchy@gmail.com a écrit :

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.com wrote:
I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch? Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?

4

On Wed, May 9, 2012 at 10:53 PM, Shay Banon kimchy@gmail.com wrote:

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch?
    Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?

We have Hadoop cluster and I was wondering if I can store everything on
HDFS instead of locally so that I have all my data in HDFS. Does
elasticsearch let you do that with HDFS or is it just for backups? I see
there is a Gateway but don't really understand how elasticsearch integrates
with HDFS.