I want to migrate the data from one elasticsearch cluster to another using reindexing from a remote server approach.
Calling reindex API multiple times does the migration activity from scratch each time rather it should pick from the place where it stopped last time.
Please let me know if my understanding is correct. If not can you please suggest how can it be achieved?
Reindex without a query as selection criteria will always reindex everything. You can specify a query based on some field in your data to only reindex a subset of the data every time, e.g. new documents, but you need to manage this and keep track of query parameters yourself.
Replicating data from one cluster to another is what cross-cluster replication was designed to do, but be aware that this is a commercial feature not available with the free Basic license.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.