Enabling multiple snapshot operations in ES 6.5.4

Elastic Stack Elasticsearch
1

We have ES 6.5.4 and using S3 repository in our different machines. We move data from one machine to another using snapshot/restore process. Now only 1 concurrent snapshot operation is allowed per machine. If we do some other snapshot operation during one operation already in progress, we are getting error as below,

{
  "error": {
    "root_cause": [
      {
        "type": "concurrent_snapshot_execution_exception",
        "reason": "[REPO_NAME:test11]  a snapshot is already running"
      }
    ],
    "type": "concurrent_snapshot_execution_exception",
    "reason": "[REPO_NAME:test11]  a snapshot is already running"
  },
  "status": 503
}

As we are getting more data to move from one machine to another, this phase has become bottleneck of our pipeline.

There is a way to do multiple snapshot operations in ES 8.6 . It has default limit of 1000.

ES documentation for 8.6

Is there any way we can enable multiple snapshot operation in ES 6.5.4 ?

2

No, I do not believe there is. Be aware that the version you are using is very old and EOL, so I would recommend upgrading to the latest version anyway.

3

Thanks @Christian_Dahlqvist for replying.

I am getting your point but changing ES version is a huge step for our company. We have many products, APIs and search facility running on production with this version.

Changing version would be last step for scenarios like us.

4

I believe this area has been changed significantly in recent versions so do unfortunately not think there are any workarounds in an old version like 6.5.4. Let's see if anyone else has any suggestions.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.