Hello, I have a plan to use ingest pipeline on my cluster, the plan is: 90 application will hit to elastic server, so I'll make around 200 pipeline on my cluster How can I scale the ingest node I need on my cluster to make this possible Thanks in advance

First I miss-understood I thought you meant 1500 EPM Total, but really you meant about 30K EPM Total, that should still be fine as that is really only about 500 Events / Sec... you should probably be able to scale a 4 CPU 8 GB RAM Ingest node to about 7-10x that ... about 3500 - 5000 Events / Sec fo…

Discuss the Elastic Stack

Scale ingest node based on number of application

Elastic Stack Elasticsearch

alfianaf (Alfian Aulia Firdaus) October 13, 2021, 5:02am 2

anyone know the method to scale the number of the ingest node pls

Topic		Replies	Views
Elasticsearch Cluster Ingest Node Sizing Elasticsearch ingest-pipeline	4	1564	April 6, 2022
Sizing an ingest node Elasticsearch	1	413	July 5, 2017
Ingest Node Problems Elasticsearch	4	1500	December 7, 2018
Ingest Node capability in heavy load of docs Elasticsearch	4	447	July 23, 2020
Rendimiento en ingesta - Nodos de coordinación Elastic en Español	3	1057	February 16, 2021

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Scale ingest node based on number of application

Related topics