Hi ! I'm trying to fetch +1 Million records from elastic search. So far all approaches are still slow. At the moment I'm using a sliced scroll search. I just need a few fields from the documents, not the whole document. Is there a way I can optimize this ? Thanks!

Fetch 1 million records

rugenl (Len Rugen) February 25, 2020, 4:15am 2

I think this describes what you can try, but read the warnings about text fields.

Let us know how it works out

Topic		Replies	Views
Retrieving over a million records in Elasticsearch Elasticsearch	10	27884	July 5, 2017
Slow results retrieval Elasticsearch	5	399	December 17, 2018
Exporting Indexed Data Elasticsearch	6	11084	September 25, 2019
Fasted way to receive large results Elasticsearch	2	1630	July 6, 2017
Extracting fields in bulk - using ES as a data store Elasticsearch	4	550	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Fetch 1 million records

Related Topics