I am trying to migrate some indices from my Elastic Cloud Cluster to AWS ES.
Since everything is on cloud i am unable to achieve it with the tutorials and demos listed out in the internet;
While there are couple methods: Snapshot Restore, Re-Index, Using Logstash (elasticsearch as input and amazon-es as outtput)... I am having hard time unable to achieve the use case using any of the method.
Thanks for you rresponse @dadoonet. It was a clients requirement. But we are not entirely moving out. We just wanted to contrast the features (like X-Pack, Reporting, accessibility) to convince the client to stick to elastic. For that we needed the same data in the amazon elasticsearch.
So, is it at least possible to dump the data onto a elasticsearch running on my local system? If so how do we do it?
Lastly, how can we create a snapshot of a specific index of an instance hosted on elastic cloud?
I request you to kindly provide me some insight please?
Thanks for your response @Christian_Dahlqvist I tried to search through the documentation, but i did not find a procedure to do it for elastic cloud instance. I did go through the APIs and some tutorials where they could give the location or path for repositories in the elasticsearch.yml file to generate the snapshot, but what do it do in case elastic cloud?
Could you please share any links or the documentation references for taking a custom snapshot of a elastic cloud index?
You should be able to create your own S3 repository and snapshot to that. Whether you can import that to AWS ES or not I do however not know. As I mentioned, versions used might be a problem. A snapshot can not be read by an older version of Elasticsearch than it was created with. If AWS ES does not support the version you are running on Elastic Elasticsearch Service or newer, I suspect reindexing from remote is the best option.
The S3 could be on my own AWS account? how do i reference it while creating the snapshot of an index in elastic cloud? I generally use the Dev Tools of Kibana to run the APIs. Could you please share any references or links about the procedure please?
I do not have a problem with that as the elastic cloud i am running is a 6.3.2 and AWS also on the same