Hdfs file missing (snapshot)

Elastic Stack Elasticsearch
1

my snapshot:

{
  "hdfs_repository_ccres": {
    "type": "hdfs",
    "settings": {
      "path": "/user/elasticsearch/snapshots",
      "uri": "hdfs://master1:8020/"
    }
  }
}

when i use

GET _snapshot/hdfs_repository_ccres/_all

get


{
  "error": {
    "root_cause": [
      {
        "type": "snapshot_missing_exception",
        "reason": "[hdfs_repository_ccres:short-video-production-2019-v2-snapshot1559067304953/uZyUEl-YT7eUBotTzsgM7g]  is missing"
      }
    ],
    "type": "snapshot_exception",
    "reason": "[hdfs_repository_ccres:short-video-production-2019-v2-snapshot1559067304953/uZyUEl-YT7eUBotTzsgM7g] Snapshot could not be read",
    "caused_by": {
      "type": "snapshot_missing_exception",
      "reason": "[hdfs_repository_ccres:short-video-production-2019-v2-snapshot1559067304953/uZyUEl-YT7eUBotTzsgM7g]  is missing",
      "caused_by": {
        "type": "no_such_file_exception",
        "reason": "Blob [snap-uZyUEl-YT7eUBotTzsgM7g.dat] does not exist"
      }
    }
  },
  "status": 500
}
2

es version: 5.5.0

3

Any response is valuable

4

It looks like snap-uZyUEl-YT7eUBotTzsgM7g.dat is missing in HDFS. It's hard to say why without more information though. Is there anything interesting in your log files (on any Elasticsearch nodes or the Hadoop namenode or data nodes)? Is it possible that someone manually deleted it from HDFS? Here is where that error comes from in the code: elasticsearch/HdfsBlobContainer.java at v5.5.0 · elastic/elasticsearch · GitHub. But that is a very old version and that code looks different now. I would upgrade if at all possible.

1 Like
5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.