Index backup in elasticsearch cluster


(sami) #1

I am trying to backup an index in a 5 node elastic cluster but its failing . The directories are there but it seems it wants a shared folder among all the cluster nodes?

[elasticsearch@hadoop5 logs]$ curl -XPUT 'hadoop1:9200/_snapshot/pa_acct_bck' -H 'Content-Type: application/json' -d '{

"type":"fs",
"indices":"pa_acct",
"ignore_unavailable":"true",
"include_global_state":"false",
"settings":{
"location":"pa_acct",
"compress":"true"
}
}'
{"error":{"root_cause":[{"type":"repository_verification_exception","reason":"[pa_acct_bck] [[KGSXx4blQFmBsORiP8ZB2g, 'RemoteTransportException[[hadoop2][10.100.44.16:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop2}{KGSXx4blQFmBsORiP8ZB2g}{cAJ9mafARnm6dV_vFm0YtQ}{hadoop2}{10.100.44.16:9300}{ml.machine_memory=12626190336, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [YVw8QqIPTnu-uSGAgoPPwg, 'RemoteTransportException[[hadoop4][10.100.44.18:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop4}{YVw8QqIPTnu-uSGAgoPPwg}{wAsGvPnBQdWvjRVH_rigAw}{hadoop4}{10.100.44.18:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [6jaRyT9SSCCBMKAR4jw6rw, 'RemoteTransportException[[hadoop3][10.100.44.19:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop3}{6jaRyT9SSCCBMKAR4jw6rw}{PPzZkpnrSQOBMPTjj0PONA}{hadoop3}{10.100.44.19:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [5S-zehHQSO6OpIncrOfGlg, 'RemoteTransportException[[hadoop5][10.100.44.20:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop5}{5S-zehHQSO6OpIncrOfGlg}{pqumIo2tQXKMtpuorTMo0Q}{hadoop5}{10.100.44.20:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"}],"type":"repository_verification_exception","reason":"[pa_acct_bck] [[KGSXx4blQFmBsORiP8ZB2g, 'RemoteTransportException[[hadoop2][10.100.44.16:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop2}{KGSXx4blQFmBsORiP8ZB2g}{cAJ9mafARnm6dV_vFm0YtQ}{hadoop2}{10.100.44.16:9300}{ml.machine_memory=12626190336, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [YVw8QqIPTnu-uSGAgoPPwg, 'RemoteTransportException[[hadoop4][10.100.44.18:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop4}{YVw8QqIPTnu-uSGAgoPPwg}{wAsGvPnBQdWvjRVH_rigAw}{hadoop4}{10.100.44.18:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [6jaRyT9SSCCBMKAR4jw6rw, 'RemoteTransportException[[hadoop3][10.100.44.19:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop3}{6jaRyT9SSCCBMKAR4jw6rw}{PPzZkpnrSQOBMPTjj0PONA}{hadoop3}{10.100.44.19:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [5S-zehHQSO6OpIncrOfGlg, 'RemoteTransportException[[hadoop5][10.100.44.20:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[pa_acct_bck] a file written by master to the store [/u01/elastic/es_backup/pa_acct] cannot be accessed on the node [{hadoop5}{5S-zehHQSO6OpIncrOfGlg}{pqumIo2tQXKMtpuorTMo0Q}{hadoop5}{10.100.44.20:9300}{ml.machine_memory=12491927552, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}]. This might indicate that the store [/u01/elastic/es_backup/pa_acct] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"},"status":500}[elasticsearch@hadoop5 logs]$
[elasticsearch@hadoop5 logs]$


(sami) #2

ok I found out it needs a nfs mounted share... I created it .


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.