# Repository verification exception

**URL:** <https://discuss.elastic.co/t/repository-verification-exception/91105>\
**Category:** Elasticsearch\
**Created:** [June 28, 2017, 1:00pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105 "2017-06-28T13:00:10Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![kabali12345](https://avatars.discourse-cdn.com/v4/letter/k/6a8cbe/32.png) [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Post date:** [June 28, 2017, 1:00pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/1 "2017-06-28T13:00:10Z")

</div>

Hi all  
i have a 5 node cluster where 3 nodes are data nodes, 1 is master and 1 is client node  
on this cluster when trying to create snapshot i am getting following error

```auto
{
  "error": {
    "root_cause": [
      {
        "type": "repository_verification_exception",
        "reason": "[sgpl_backup2] [[Uu67NQqXQVaT1maJ49apng, 'RemoteTransportException[[node72][192.168.1.72:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node72}{Uu67NQqXQVaT1maJ49apng}{IQI8z2v7QzeohCBSFOZHRA}{192.168.1.72}{192.168.1.72:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [mHR3zxDqQCqDvGNBxUF2tw, 'RemoteTransportException[[node73][192.168.1.73:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node73}{mHR3zxDqQCqDvGNBxUF2tw}{BwILk21wR4GlJaWDy-DHFg}{192.168.1.73}{192.168.1.73:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [XEgaW0CvQt-02VEczOmHoA, 'RemoteTransportException[[node71][192.168.1.71:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node71}{XEgaW0CvQt-02VEczOmHoA}{WMgwMgp_QLae61ux_xPqtA}{192.168.1.71}{192.168.1.71:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"
      }
    ],
    "type": "repository_verification_exception",
    "reason": "[sgpl_backup2] [[Uu67NQqXQVaT1maJ49apng, 'RemoteTransportException[[node72][192.168.1.72:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node72}{Uu67NQqXQVaT1maJ49apng}{IQI8z2v7QzeohCBSFOZHRA}{192.168.1.72}{192.168.1.72:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [mHR3zxDqQCqDvGNBxUF2tw, 'RemoteTransportException[[node73][192.168.1.73:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node73}{mHR3zxDqQCqDvGNBxUF2tw}{BwILk21wR4GlJaWDy-DHFg}{192.168.1.73}{192.168.1.73:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [XEgaW0CvQt-02VEczOmHoA, 'RemoteTransportException[[node71][192.168.1.71:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[sgpl_backup2] a file written by master to the store [/home/sgpl/elasticsearch_backup] cannot be accessed on the node [{node71}{XEgaW0CvQt-02VEczOmHoA}{WMgwMgp_QLae61ux_xPqtA}{192.168.1.71}{192.168.1.71:9300}{ml.enabled=true}]. This might indicate that the store [/home/sgpl/elasticsearch_backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"
  },
  "status": 500
}

```

how can i resolve this error ?

Thank you

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [June 28, 2017, 1:18pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/2 "2017-06-28T13:18:26Z")

</div>

Home did you mount the shared dir on all nodes?

---

<div class="post-metadata">

**Author:** ![kabali12345](https://avatars.discourse-cdn.com/v4/letter/k/6a8cbe/32.png) [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Post date:** [June 28, 2017, 1:21pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/3 "2017-06-28T13:21:44Z")

</div>

This is my repo path  
path.repo: ["/home/sgpl/elasticsearch\_backup"]

with the help of below command i have given all permission to that repo.path and where sgpl is user of elasticsearch  
sudo chown -R sgpl:sgpl /home/sgpl/elasticsearch\_backup/

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 28, 2017, 1:53pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/4 "2017-06-28T13:53:36Z")

</div>

Is this a shared filesystem that is available to ALL the nodes in the cluster at the same path?

---

<div class="post-metadata">

**Author:** ![kabali12345](https://avatars.discourse-cdn.com/v4/letter/k/6a8cbe/32.png) [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Post date:** [June 28, 2017, 3:13pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/5 "2017-06-28T15:13:39Z")

</div>

Yes it is available in all DATA( 3 nodes ) and Master( 1 node ) nodes ,  
but not in client node .

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 28, 2017, 4:32pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/6 "2017-06-28T16:32:57Z")

</div>

What kind of device is it? NFS volume?

---

<div class="post-metadata">

**Author:** ![kabali12345](https://avatars.discourse-cdn.com/v4/letter/k/6a8cbe/32.png) [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Post date:** [June 29, 2017, 8:11am UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/7 "2017-06-29T08:11:49Z")

</div>

```auto
[root@elasticsearch_masternode ~]# cat /etc/redhat-release 
CentOS Linux release 7.2.1511 (Core) 

```

```auto
[root@elasticsearch_masternode ~]# uname -a
Linux elasticsearch_masternode 3.10.0-327.el7.x86_64 #1 SMP Thu Nov 19 22:10:57 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

```

and as of know i do not have much knowledge about NFS and how it (NFS) is a part of snapshot and recovery process

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [June 29, 2017, 8:26am UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/8 "2017-06-29T08:26:47Z")

</div>

You need to have a shared volume, e.g. a NFS volume, behind the repository path that all nodes can access. This means that if node1 writes a file it will be visible by node 2 and node 3. A directory in the local file system will therefore not work, even if the path is identical on all machines.

---

<div class="post-metadata">

**Author:** ![kabali12345](https://avatars.discourse-cdn.com/v4/letter/k/6a8cbe/32.png) [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Post date:** [June 29, 2017, 12:00pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/9 "2017-06-29T12:00:05Z")

</div>

would you suggest me how do i **have a shared volume, e.g. a NFS volume, behind the repository path that all nodes can access.**  
if possible provide me some web links which helps me.

Thank you.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 27, 2017, 12:00pm UTC](https://discuss.elastic.co/t/repository-verification-exception/91105/10 "2017-07-27T12:00:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
