I am using elasticsearch 5.6.4 and I have a very update heavy workload. I have my
refresh_interval set to
10s. However, I'm seeing hundreds of concurrent refreshes going on (with a max refresh time of ~5s). Is there a way to determine what is triggering these refreshes?
Based on this, I've tried setting up a lock system so that the same document is only updated once every five minutes, but I'm still seeing this large amount of refreshes.
I am making all the updates as scripted upserts through the bulk api with