Index from another index


(Uber777) #1

So I have a logstash index.

How do I extract (regex) key values like Error type, date and time for
their own elastic search index from an existing index?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Alexander Reelsen) #2

Hey,

your requirement basically means, that you have to retrieve every document
from your index, modify it (in your case remove some fields except three)
and then reindex your document. I am not sure, if there is some automatic
tool for this, but it only requires two manual steps, so it is quite simple
to do it yourself

You can use the scroll query for this, see
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-scroll.html
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-search-type.html#scan

While you are getting back the results, you could use a
python/ruby/whateveryoulike script to do the actuall modifications and
execute the index operation in another index (preferrably batched).

Hope this helps

--Alex

On Wed, Oct 30, 2013 at 3:00 PM, Uber777 nkatsikanis@gmail.com wrote:

So I have a logstash index.

How do I extract (regex) key values like Error type, date and time for
their own elastic search index from an existing index?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #3