How to: reindex data?


(Andrew Lakes) #1

Hey guys,

we encountered a small problem with our new elasticsearch cluster.

Logstash indexed a whole lot of useless fields like "<133>Sep 7 02:42:43
server apache2-access: accesstime" due to a misconfiguration from us and
now we got about 95000 useless fields that slow down Kibana a lot, cause
kibana is loading /_all/_mapping everytime you load a dashboad in order to
get the right fields for the table-panel

I read a bit and saw that deleting fields only is available with reindex
the whole index.

We use the version 1.3.2 of elasticsearch and our indices got the default
names from logstash ("logstash-2014.09.08").

So for example, how do i manage the reindex that index? I´ve read sth about
making aliases and point the alias to the old index and than reindex - but
how is that exactly working?

Thanks for response.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/28fa5d25-0af2-4319-931d-7b1674e566ff%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(vineeth mohan-2) #2

Hello Andrew ,

First use the remove field functionality in update API -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-update.html

Then use update by query plugin ( use match_all as query) to implement this
to every documents -

Thanks
Vineeth

On Mon, Sep 8, 2014 at 12:28 PM, Andrew Lakes alakes501@gmail.com wrote:

Hey guys,

we encountered a small problem with our new elasticsearch cluster.

Logstash indexed a whole lot of useless fields like "<133>Sep 7 02:42:43
server apache2-access: accesstime" due to a misconfiguration from us and
now we got about 95000 useless fields that slow down Kibana a lot, cause
kibana is loading /_all/_mapping everytime you load a dashboad in order to
get the right fields for the table-panel

I read a bit and saw that deleting fields only is available with reindex
the whole index.

We use the version 1.3.2 of elasticsearch and our indices got the default
names from logstash ("logstash-2014.09.08").

So for example, how do i manage the reindex that index? I´ve read sth
about making aliases and point the alias to the old index and than reindex

  • but how is that exactly working?

Thanks for response.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/28fa5d25-0af2-4319-931d-7b1674e566ff%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/28fa5d25-0af2-4319-931d-7b1674e566ff%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGdPd5kHaJXkOnDMU2n0S0KO5U%2Bz1jGALHunm21F%2BKOEeCK%2BGg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3