ElasticSearch data to a simple file


(Prab) #1

Hello,

I would like to convert all data stored in ES to a simple file. Exact use
case is,

I would be storing logs in ES with timestamp as index and when user
triggers a file request operation it should provide a log file (in a file
system) with all the data.

is there anyway to do this? ( i was thinking to search for _all and parse
the JSON and then add to a file - this is going to be a over kill)

-Prab


(Ivan Brusic) #2

It is more efficient to scan across your values:

http://www.elasticsearch.org/guide/reference/api/search/scroll.html

However, if your data is large enough to merit use a scan, then
perhaps it is too big to place into a file. How many documents will
you be outputting?

--
Ivan

On Mon, May 28, 2012 at 2:16 AM, Prab itsmeprabhakar@gmail.com wrote:

Hello,

I would like to convert all data stored in ES to a simple file. Exact use
case is,

I would be storing logs in ES with timestamp as index and when user triggers
a file request operation it should provide a log file (in a file system)
with all the data.

is there anyway to do this? ( i was thinking to search for _all and parse
the JSON and then add to a file - this is going to be a over kill)

-Prab


(system) #3