Reindexing Performance


(Jomar Manalo) #1

Hi,

We are having problems with reindexing our data. Can you advice what to do on how to reindex while not affecting search speed of other indices? reindexing takes alot of resource.

Thanks!


(Christian Stockhaus) #2

you could use the requests_per_second parameter of the reindex request to controll how much documents are reindexed per second.
(https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-reindex.html#_url_parameters_3)
That will logically reduce the speed of the reindexing

POST _reindex?wait_for_completion=false&requests_per_second=3000&refresh=true
{
  "source": {
    "index": "test-2018.01"
  },
  "dest": {
    "index": "test-2018"
  }
}

(Jomar Manalo) #3

Hi Shaoranlaos, thank you very much! Will try this out :slight_smile:


(Jomar Manalo) #4

Hi Shao,

I have another concern, after re indexing, how can we throttle populating the replica shards? because this also takes resource and affects our search performance.


(Christian Stockhaus) #5

sorry i haven't found anything for this
i myself work only with one node so this was never a concern


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.