We are importing data to elasticsearch cluster in few indices, around ~10gb each. At the same time, we care about search on existing indices, few of them are small-~100mb, few of them are big-~10gb. In order to optimize indexing, we: use bulk api with optimized bulk size; set refresh interval to…

Elasticsearch indexing performance: throttle merging

Christian_Dahlqvist (Christian Dahlqvist) January 16, 2017, 8:15am 8

Are you indexing into these indices continuously or doing bulk inserts/updates periodically?

Indexing performance degradation over time

Topic		Replies	Views
Merging and indices.store.throttle.max_bytes_per_sec Elasticsearch	1	741	November 27, 2017
Indices.store.throttle.max_bytes_per_sec config setting and 2.2 Elasticsearch	3	2265	July 5, 2017
Optimize elasticsearch segment merge Elasticsearch	5	1595	May 1, 2020
Force Merge Segments - Avoid Throttling Elasticsearch	3	485	May 20, 2019
Merge throttling is preventing heavy bulk indexing (ES 1.7.5) Elasticsearch	5	1922	July 5, 2017