Cross cluster indice migration issue


(Olivier Dauby) #1

Hi *,

We are currently using several Elasticsearch clusters for our customers.
For one of our customers I have to perform a data migration from PROD to QA environment. We do this from time to time, without any issue, but this customer is using Elasticsearch on Windows and I did not manage to migrate the data from the PROD cluster to the QA cluster.

Process goes like this:

  • A snapshot is taken on the PROD cluster
  • The snapshot directory is zipped, transferred to the QA area and decompressed.
  • A migration repository is created on QA Elasticsearch pointing to this new location.
  • A snapshot restore is triggered on QA Elasticsearch cluster.

This is this last step that fails miserably. WHen I check the available snapshots in the repository, I get this error message:

Invoke-RestMethod http://localhost:9200/_snapshot/elasticsearch_fromprod/_all

Error message:
Invoke-RestMethod : {"error":"ElasticsearchParseException[Failed to derive xcontent from (offset=0, length=0):
[]]","status":400}
At line:1 char:1

  • Invoke-RestMethod http://localhost:9200/_snapshot/elasticsearch_fromprod/_all
  •   + CategoryInfo          : InvalidOperation: (System.Net.HttpWebRequest:HttpWebRequest) [Invoke-RestMethod], WebExc
     eption
      + FullyQualifiedErrorId : WebCmdletWebResponseException,Microsoft.PowerShell.Commands.InvokeRestMethodCommand
    
    
    
  • Java 7u71 and Elasticsearch 1.3.2 are the same versions on PROD and QA ES nodes
  • I gave full rights and even ownership to the QA user running Elasticsearch service on the snapshot repository.
  • Snapshot and restore work like a charm on the other repositories of the QA cluster.

Any idea what the issue could be ?

Kind Regards,

O.


(system) #2