Merge 500 daily indices to weekly / Reindex data

Elastic Stack Elasticsearch
1

Hi there.

  1. How to merge 500 daily indices to weekly? Will this increase the search speed? If it possible?
    1.1) What can increase speed of search expect of my hardware? :sweat_smile:
  2. What is the best way to reindex data? Because, there are many wrong fields that I need reindex with updated config.
2

Try something like this - Kibana only display logo no content -elasticsearch error shard

3

But will it increase the search speed?

4

It should, yes.

1 Like
5

Okay, so could you please explain me more details about this:

PUT lcch-cisco-2018.03
    POST _reindex
    {
      "source": {
        "remote": {
          "host": "http://localhost:9200"
        },
        "index": "lcch-cisco-2018.03.*"
      },
      "dest": {
        "index": "lcch-cisco-2018.03"
      }
    }

It's mean that all indexers random-name-2018.03. will as random-name 2018.3 as month? And I can by this method to merge to weekly? Yes?
So, how to do it not manual by this action? How to setup it automatic, so it will be automatically generates weekly indices?

And they will be automatic updated with my new config and it's will fix wrong field, or for this step I need to do something else?

6

@warkolm
This tool https://www.npmjs.com/package/elasticsearch-reindex
make the same as your script?

7

If you want it automatic then look at using ILM - https://www.elastic.co/guide/en/elasticsearch///reference/master/ilm-start.html

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.