I want to create Snapshots of indices on External Hard Drive

Elastic Stack Elasticsearch
#1

Hi ,

I have created NFS location in my cluster that is accessible from all the nodes.

I checked it through terminal, The Repository has read and write both permissions.

But when i create a repository from kibana terminal or dev tools i get following error

test] [[ZehcpwR6Qqe48yhIl_RcUw, 'RemoteTransportException[[kibana-data][192.168.140.16:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[test] store location [/mnt/node] is not accessible on the node [{kibana-data}{ZehcpwR6Qqe48yhIl_RcUw}{sLtnj5QjTdiBCKUwqlyUXw}{192.168.140.16}{192.168.140.16:9300}{dilrt}{ml.machine_memory=8201338880, xpack.installed=true, transform.node=true, ml.max_open_jobs=20}]]; nested: AccessDeniedException[/mnt/node/tests-n396HbR9Q-udjW7-pLcqLw/data-ZehcpwR6Qqe48yhIl_RcUw.dat];']]

#2

That would suggest that the directory does not have the right permissions.

#3

I gave chmode -R 777 to directory and also set chown as elasticsearch
Please suggest what permissions are required
Because i tried read write operation from other node via terminal it is working.

#4

What is the output from ls -ld /mnt/node and mount?

#5

Following tis the output of ls -ld /mnt/node
192.168.140.15:/mnt/node 1.8T 1.6T 300G 84% /mnt/node

Following tis the output of df -kh
Filesystem Size Used Avail Use% Mounted on
devtmpfs 7.8G 0 7.8G 0% /dev
tmpfs 7.8G 0 7.8G 0% /dev/shm
tmpfs 7.8G 793M 7.0G 10% /run
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/centos-root 1.8T 1.8T 101G 95% /
/dev/vda2 50G 45G 5.4G 90% /boot
tmpfs 1.6G 4.0K 1.6G 1% /run/user/42
tmpfs 1.6G 36K 1.6G 1% /run/user/0
192.168.140.15:/mnt/node 1.8T 1.6T 300G 84% /mnt/node

Following is the output of mount

192.168.140.15:/mnt/node on /mnt/node type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.140.11,local_lock=none,addr=192.168.140.15)

#6

I got the problem

In the data node when writing in the repo directory ,
instead of elasticsearch its writing with kibana user
other node are taking elasticsearch only problem in kibana node.
is their any linux command to change that
I already chown -R elasticsearch:elasticsearch to the directory