I've been attempting to migrate about 3TB of data from an AWS Elasticsearch Service cluster to a self managed Elasticsearch cluster made with EC2 instances. I was going to use snapshots to help with transferring all this data. Attempting to restore the snapshot to a self managed cluster has resulted in this error message:
{
"error": {
"root_cause": [
{
"type": "snapshot_restore_exception",
"reason": "[backup:snapshot_2020071616/8sr3LiykSRmm5Eeq00y9LQ] the snapshot was created with Elasticsearch version [5.6.17] which is higher than the version of this node [5.6.16]"
}
],
"type": "snapshot_restore_exception",
"reason": "[backup:snapshot_2020071616/8sr3LiykSRmm5Eeq00y9LQ] the snapshot was created with Elasticsearch version [5.6.17] which is higher than the version of this node [5.6.16]"
},
"status": 500
}
Is there anyway to downgrade the snapshot version? Remote reindexing from the AWS Elasticsearch service is out of the question (remote reindexing is not supported) and Logstash is not an option either as it takes far too long to migrate the data compared to using snapshots (we're talking about 3 hours with snapshots versus 25-40 hours using Logstash).