HI Team,
I was taken snapshot of Elasticsearch version 8.8.1, Then restored that snapshot into Elasticsearch version of 8.12.0.
Now Tried to take snapshot from Elasticsearch version of 8.12.0 Getting an error as
{"@timestamp":"2024-02-01T04:43:15.953Z", "log.level": "WARN", "message":"[iqarepo:trial_data1/N-EgrZEWROeTpjvZg0NX2Q] failed to finalize snapshot", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[3b7f2c2bd948][snapshot][T#22]","log.logger":"org.elasticsearch.snapshots.SnapshotsService","elasticsearch.cluster.uuid":"Tms4mV1eTkG6AvLiZP3atA","elasticsearch.node.id":"ccHvPoQAQf6W3nQQ4iK-VQ","elasticsearch.node.name":"3b7f2c2bd948","elasticsearch.cluster.name":"docker-cluster","error.type":"org.elasticsearch.snapshots.SnapshotException","error.message":"[iqarepo:trial_data1/N-EgrZEWROeTpjvZg0NX2Q] failed to update snapshot in repository","error.stack_trace":"org.elasticsearch.snapshots.SnapshotException: [iqarepo:trial_data1/N-EgrZEWROeTpjvZg0NX2Q] failed to update snapshot in repository\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.lambda$finalizeSnapshot$22(BlobStoreRepository.java:1711)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations$DelegatingResponseActionListener.acceptException(ActionListenerImplementations.java:186)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeAcceptException(ActionListenerImplementations.java:62)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations$DelegatingResponseActionListener.onFailure(ActionListenerImplementations.java:191)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener$FailureResult.complete(SubscribableListener.java:322)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.tryComplete(SubscribableListener.java:234)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.setResult(SubscribableListener.java:259)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.onFailure(SubscribableListener.java:178)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeAcceptException(ActionListenerImplementations.java:62)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeOnFailure(ActionListenerImplementations.java:73)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.DelegatingActionListener.onFailure(DelegatingActionListener.java:27)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener$FailureResult.complete(SubscribableListener.java:322)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.tryComplete(SubscribableListener.java:234)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.setResult(SubscribableListener.java:259)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.onFailure(SubscribableListener.java:178)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeAcceptException(ActionListenerImplementations.java:62)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeOnFailure(ActionListenerImplementations.java:73)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.DelegatingActionListener.onFailure(DelegatingActionListener.java:27)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener$FailureResult.complete(SubscribableListener.java:322)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.tryComplete(SubscribableListener.java:234)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.setResult(SubscribableListener.java:259)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.SubscribableListener.onFailure(SubscribableListener.java:178)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeAcceptException(ActionListenerImplementations.java:62)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionListenerImplementations.safeOnFailure(ActionListenerImplementations.java:73)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.DelegatingActionListener.onFailure(DelegatingActionListener.java:27)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener.finish(RefCountingListener.java:127)\n\tat org.elasticsearch.base@8.12.0/org.elasticsearch.core.AbstractRefCounted$1.closeInternal(AbstractRefCounted.java:118)\n\tat org.elasticsearch.base@8.12.0/org.elasticsearch.core.AbstractRefCounted.decRef(AbstractRefCounted.java:70)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingRunnable.close(RefCountingRunnable.java:112)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener$1.onResponse(RefCountingListener.java:151)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener$1.onResponse(RefCountingListener.java:146)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:37)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:983)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1583)\nCaused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/8LiBdINARbGqO2xd6My37g/meta-IqL6Yo0BiIfppwISbmRY.dat\n\tat java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)\n\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)\n\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)\n\tat java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:261)\n\tat java.base/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:482)\n\tat java.base/java.nio.file.Files.newOutputStream(Files.java:227)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobContainer.blobOutputStream(FsBlobContainer.java:385)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobContainer.writeToPath(FsBlobContainer.java:281)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobContainer.writeMetadataBlob(FsBlobContainer.java:268)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.ChecksumBlobStoreFormat.write(ChecksumBlobStoreFormat.java:347)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.ChecksumBlobStoreFormat.write(ChecksumBlobStoreFormat.java:330)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.lambda$finalizeSnapshot$16(BlobStoreRepository.java:1636)\n\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:36)\n\t... 5 more\n\tSuppressed: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/g6LU16_RS8Ghu_qSLe6o0g/meta-I6L6Yo0BiIfppwISbmRZ.dat\n\t\t... 18 more\n\tSuppressed: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/R7zSAnXBRVm1j_H-Olpr9w/meta-JKL6Yo0BiIfppwISbmRZ.dat\n\t\t... 18 more\n\tSuppressed: org.elasticsearch.ElasticsearchException: failed to create blob container\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:61)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.indexContainer(BlobStoreRepository.java:1884)\n\t\t... 7 more\n\tCaused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/ws57SGn-TaWJQL7a54Imwg\n\t\tat java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)\n\t\tat java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:438)\n\t\tat java.base/java.nio.file.Files.createDirectory(Files.java:699)\n\t\tat java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)\n\t\tat java.base/java.nio.file.Files.createDirectories(Files.java:793)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:59)\n\t\t... 8 more\n\tSuppressed: org.elasticsearch.ElasticsearchException: failed to create blob container\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:61)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.indexContainer(BlobStoreRepository.java:1884)\n\t\t... 7 more\n\tCaused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/Rpxlp11MQ6-hHXNb9BV_cg\n\t\tat java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)\n\t\tat java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:438)\n\t\tat java.base/java.nio.file.Files.createDirectory(Files.java:699)\n\t\tat java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)\n\t\tat java.base/java.nio.file.Files.createDirectories(Files.java:793)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:59)\n\t\t... 8 more\n\tSuppressed: org.elasticsearch.ElasticsearchException: failed to create blob container\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:61)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.indexContainer(BlobStoreRepository.java:1884)\n\t\t... 7 more\n\tCaused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/rKSF6u2TT2q5e5yuhhQIKw\n\t\tat java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)\n\t\tat java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:438)\n\t\tat java.base/java.nio.file.Files.createDirectory(Files.java:699)\n\t\tat java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)\n\t\tat java.base/java.nio.file.Files.createDirectories(Files.java:793)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:59)\n\t\t... 8 more\n\tSuppressed: org.elasticsearch.ElasticsearchException: failed to create blob container\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:61)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.repositories.blobstore.BlobStoreRepository.indexContainer(BlobStoreRepository.java:1884)\n\t\t... 7 more\n\tCaused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/6HArC6K5TTyok3qwcm5TAg\n\t\tat java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)\n\t\tat java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)\n\t\tat java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:438)\n\t\tat java.base/java.nio.file.Files.createDirectory(Files.java:699)\n\t\tat java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)\n\t\tat java.base/java.nio.file.Files.createDirectories(Files.java:793)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.common.blobstore.fs.FsBlobStore.blobContainer(FsBlobStore.java:59)\n\t\t... 8 more\n\tSuppressed: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/VKqsnlDkQZuMFzY8VZSLNQ/meta-KaL6Yo0BiIfppwISbmRZ.dat\n\t\t... 18 more\n\tSuppressed: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/UhFUBfC3ShSCmWQ5fTC23A/meta-KqL6Yo0BiIfppwISbmRZ.dat\n\t\t... 18 more\n\tSuppressed: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/iqarepo/indices/hXlaUvxEThSqizfB5mHsjw/meta-K6L6Yo0BiIfppwISbmRZ.dat\n\t\t... 18 more\n\tSuppressed: org.elasticsearch.ElasticsearchException: 3 further exceptions were dropped\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener.finish(RefCountingListener.java:125)\n\t\tat org.elasticsearch.base@8.12.0/org.elasticsearch.core.AbstractRefCounted$1.closeInternal(AbstractRefCounted.java:118)\n\t\tat org.elasticsearch.base@8.12.0/org.elasticsearch.core.AbstractRefCounted.decRef(AbstractRefCounted.java:70)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingRunnable.close(RefCountingRunnable.java:112)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener$1.onResponse(RefCountingListener.java:151)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.support.RefCountingListener$1.onResponse(RefCountingListener.java:146)\n\t\tat org.elasticsearch.server@8.12.0/org.elasticsearch.action.ActionRunnable$1.doRun(ActionRunnable.java:37)\n\t\t... 5 more\n"}
License mode: basic
Deployed on: docker
Snapshot repo type : fs