Increased Search Latency post enabling writes to index

Elastic Stack Elasticsearch
1

Hi,
I m observing high search latency (8x-10x) post enabling writes on an index.
I m having an index on production having continuous writes (avg write operations/sec = ~5k) and it is having search latency of 2-4sec.
I created another index with same data on the same cluster and search latency was very low (100-200ms). What can be the reason behind this behaviour ? Please help with this.
Es Version : 8.3.2

2

Are these queries running while you are indexing into the other index you mentioned?

What is the size of the index? How many shards does it have?

What type of data does the index contain? What does the mappings look like? What is the refresh interval set to?

3

I performed reindexing earlier before running search queries (so not running parallelly). Index size is aroud ~1.4 tb (primary + replica). There are 10 primary shards and 2 replicas per shard. Refresh interval is default (1sec). Index contains product related data.

4

It was taking time because of the referesh interval being set to 1sec. Changed it to 30sec, now search latency is reduced. Thanks.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.