Updating document consumes entire 32GB RAM

Elastic Stack Elasticsearch
1

Hi,

am updating 6 million documents and what I see is this test consumes entire 32 GB RAM

and out of which 11 GB is used by ES heap and 12 GB is for Merge(not sure how 12 GB but this is understanding from node statistics)

how to do I debug this issue ? what are various I should concentrate

2

maybe start by reading into what's in node log file and take a heap dump. but does the node gave any oom?

3

Yes ES Logs prints put below messages in log

[gc][young][5323][1924] duration [1.1s], collections [1]/[1.5s], total [1.1s]/[4.2m], memory [11gb]->[10.5gb]/[15.9gb], all_pools {[young] [483.5mb]->[66.1kb]/[532.5mb]}{[survivor] [7.4mb]->[8.1mb]/[66.5mb]}{[old] [10.5gb]->[10.5gb]/[15.3gb]}

now throttling indexing: numMergesInFlight=6, maxNumMerges=5