Ingest nodes don't load balance the pipeline load


I have a ECK cluster where maintaining dedicated two ingest nodes, specially to isolate and get my pipelines working across them. While it is running I noticed only one node being utilized 100% cpu where the other one less than 1%. When I dig the issue more from following command, it clearly shows only the one node does the pipeline processing.

GET _nodes/stats/ingest?filter_path=nodes.*.ingest

From these information, what i can think of there are no load balancing happen even the cluster has got two INGEST nodes.

My question is that it doesn't make scenes only one _ingest node do the 99% of work.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.