Xml files and HDFS


(Mohit Anchlia) #1

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch? Convert
    it to JSON?
  2. Does elasticsearch integrate with hadoop HDFS?

(Shay Banon) #2

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch?
    Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?


(David Pilato) #3

You could also use the attachment plugin but with some overhead on ES side instead of overhead on your side.

David :wink:
Twitter : @dadoonet / @elasticsearchfr

Le 10 mai 2012 à 07:53, Shay Banon kimchy@gmail.com a écrit :

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.com wrote:
I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch? Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?


(Mohit Anchlia) #4

On Wed, May 9, 2012 at 10:53 PM, Shay Banon kimchy@gmail.com wrote:

On Tue, May 8, 2012 at 5:46 PM, Mohit Anchlia mohitanchlia@gmail.comwrote:

I have 2 questions:

  1. What's the best way to index xml files as docs in elasticsearch?
    Convert it to JSON?

Yes.

  1. Does elasticsearch integrate with hadoop HDFS?

In what sense?

We have Hadoop cluster and I was wondering if I can store everything on
HDFS instead of locally so that I have all my data in HDFS. Does
elasticsearch let you do that with HDFS or is it just for backups? I see
there is a Gateway but don't really understand how elasticsearch integrates
with HDFS.


(system) #5