Hi,
I have a ECK cluster where maintaining dedicated two ingest nodes, specially to isolate and get my pipelines working across them. While it is running I noticed only one node being utilized 100% cpu where the other one less than 1%. When I dig the issue more from following command, it clearly shows only the one node does the pipeline processing.
GET _nodes/stats/ingest?filter_path=nodes.*.ingest
From these information, what i can think of there are no load balancing happen even the cluster has got two INGEST nodes.
My question is that it doesn't make scenes only one _ingest node do the 99% of work.