I have written an Elasticsearch plugin ( analyzes the UserAgent string ) that works the way I have in mind when I put it in a pipeline. (see Elastic Search | Yauaa - Yet Another UserAgent Analyzer ) Now on my laptop I want to put a rather large dataset (~100M records) in Elasticsearch via this plug…

The only way I can think to influence this would be to run multiple nodes on the host. Maybe someone else can comment though?

Discuss the Elastic Stack

How to run multiple indexing threads on a single machine?

Elastic Stack Elasticsearch

Niels_Basjes (Niels Basjes) August 3, 2022, 8:44am 3

This clarifies a lot.
I'm going to try a different approach now.
Thanks!

Topic		Replies	Views
Ingest Pipeline threads Elasticsearch	2	346	October 28, 2022
Search thread problem Elasticsearch	1	312	July 6, 2017
How to increase indexing speed? Elasticsearch	5	5473	April 18, 2017
Elastic search indexing tuninig Elasticsearch	7	434	February 26, 2019
Multiple core cpu Elasticsearch	6	2865	January 28, 2018

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How to run multiple indexing threads on a single machine?

Related topics