Hello, I am helping with a project that is using an ingest pipeline, specifically the enrich processor. The enrich processor is pulling from a source index that is fairly small (300k records, ~25MB). The documents that are being "enriched" are coming in at a rate of 2500/s. When running on a single…

Enrich Processor is slow on multi nodes

warkolm (Mark Walkom) January 6, 2021, 2:21am 10

It's going to be easier if we can keep a single thread with all the info. Let's carry on here please

1 Like

Topic		Replies	Views
Updating enrich index for pipeline Elasticsearch	8	715	September 9, 2023
Performance bottleneck enriching documents due to only a single node processing the ingest pipelines Elasticsearch ingest-pipeline	7	458	November 9, 2022
ES Cloud - Running ingest pipelines on warm nodes? Elasticsearch ingest-pipeline	41	1649	February 4, 2021
Enrich processor high cpu load Elasticsearch ingest-pipeline	8	1136	October 21, 2021
Ingest-geoip plugin performance Elasticsearch	8	1990	January 16, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Enrich Processor is slow on multi nodes

Related topics