I have the ES cluster with 9 shards and replicas, where all the data is
stored locally on the nodes. We have the process complete data migration
from one system to another. Since introduction of ES - we need to be able to
migrate also ES indices. We are using Netapp snap-mirror mechanism for the
rest of the data.
What would be the best practice, so, when the second system starts it will
actually build the cluster from migrated data.
Add new nodes to the existing cluster, increase replication factor and,
after you've verified all data has been replicated over, shut down old
nodes... slowly, making sure the cluster state doesn't turn red.
On Monday, November 5, 2012 1:14:05 AM UTC-5, Pasha wrote:
I have the ES cluster with 9 shards and replicas, where all the data is
stored locally on the nodes. We have the process complete data migration
from one system to another. Since introduction of ES - we need to be able
to
migrate also ES indices. We are using Netapp snap-mirror mechanism for the
rest of the data.
What would be the best practice, so, when the second system starts it will
actually build the cluster from migrated data.
Thank you for your replies and I would like to express myself more clearly (sorry for mess).
We have staging and production system and we have the process in place of move data from production to staging environments
ES cluster is currently configured to write its data on the local cluster machines. I need to store cluster data on the centralized storage (Netapp)
On the staging environment - we perform full cluster restart that points to predefined central storage (Netapp) for this environment and "imports" copied cluster data.
Actually it looks like I need the live replica of the ES cluster data to be saved in central place
So, mu questions are:
What would be the best practice for storing cluster data in centralized place (instead or in parallel with local nodes).
Should I use gateway or point the cluster files to the central storage place?
Are replicas stored with the cluster data upon shutdown and restart?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.