# HDFS respository issue

**URL:** <https://discuss.elastic.co/t/hdfs-respository-issue/116465>\
**Category:** Elasticsearch\
**Created:** [January 22, 2018, 10:03am UTC](https://discuss.elastic.co/t/hdfs-respository-issue/116465 "2018-01-22T10:03:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![saijana](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/saijana/32/46197_2.png) [@saijana](https://discuss.elastic.co/u/saijana)\
**Post date:** [January 22, 2018, 10:03am UTC](https://discuss.elastic.co/t/hdfs-respository-issue/116465/1 "2018-01-22T10:03:45Z")

</div>

Hi,

I am trying to create a repository in hdfs

1)elasticsearch.yml file:

```
security.manager.enabled: false
repositories.hdfs:
    uri: "hdfs://hostname:port/" # optional - Hadoop file-system URI
    path: "user/ESindex" # required - path with the file-system where data is stored/loaded

```

Note: the path is not created in hdfs.

when I try to create a repository now..it is getting created somewhere..It's not showing any error in elasticsearch..

```
PUT /_snapshot/hdfsbackup
{
  "type": "hdfs",
  "settings": {
    "path": "user/ESindex"
  }
}

```

response:

```
{
    "acknowledged": true
}

```

question : Is it hitting the hdfs and storing somewhere?..

1. when I try to create a repository in a path in hdfs which is already there and full persmisson ..I am getting error.

Please help.

---

<div class="post-metadata">

**Author:** ![saijana](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/saijana/32/46197_2.png) [@saijana](https://discuss.elastic.co/u/saijana)\
**Post date:** [January 22, 2018, 10:14am UTC](https://discuss.elastic.co/t/hdfs-respository-issue/116465/2 "2018-01-22T10:14:57Z")

</div>

Elasticsearch Logs:

[2018-01-22 11:11:10,746][INFO][repositories] [Zero-G] update repository [hdfsbackup]  
[2018-01-22 11:11:10,748][WARN][rest.suppressed] path: /\_snapshot/hdfsbackup, params: {repository=hdfsbackup}  
RepositoryVerificationException[[hdfsbackup] path is not accessible on master node]; nested: IOException[Mkdirs failed to create file:/user/ESindex/tests-I893LvM6SQiy77Sk22pZLg (exists=false, cwd=file:/appl/essapp/encrypt\_try/elasticsearch-2.3.5/bin)];  
at org.elasticsearch.repositories.blobstore.BlobStoreRepository.startVerification(BlobStoreRepository.java:648)  
at org.elasticsearch.repositories.RepositoriesService.verifyRepository(RepositoriesService.java:211)  
at org.elasticsearch.repositories.RepositoriesService$VerifyingRegisterRepositoryListener.onResponse(RepositoriesService.java:436)  
at org.elasticsearch.repositories.RepositoriesService$VerifyingRegisterRepositoryListener.onResponse(RepositoriesService.java:421)  
at org.elasticsearch.cluster.AckedClusterStateUpdateTask.onAllNodesAcked(AckedClusterStateUpdateTask.java:63)  
at org.elasticsearch.cluster.service.InternalClusterService$SafeAckedClusterStateTaskListener.onAllNodesAcked(InternalClusterService.java:733)  
at org.elasticsearch.cluster.service.InternalClusterService$AckCountDownListener.onNodeAck(InternalClusterService.java:1013)  
at org.elasticsearch.cluster.service.InternalClusterService$DelegetingAckListener.onNodeAck(InternalClusterService.java:952)  
at org.elasticsearch.cluster.service.InternalClusterService.runTasksForExecutor(InternalClusterService.java:637)  
at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:772)  
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231)  
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  
at java.lang.Thread.run(Thread.java:748)  
Caused by: java.io.IOException: Mkdirs failed to create file:/user/ESindex/tests-I893LvM6SQiy77Sk22pZLg (exists=false, cwd=file:/appl/essapp/encrypt\_try/elasticsearch-2.3.5/bin)  
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:450)  
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)  
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909)  
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890)  
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:852)  
at org.elasticsearch.hadoop.hdfs.blobstore.HdfsBlobContainer.createOutput(HdfsBlobContainer.java:132)  
at org.elasticsearch.hadoop.hdfs.blobstore.HdfsBlobContainer.access$000(HdfsBlobContainer.java:43)  
at org.elasticsearch.hadoop.hdfs.blobstore.HdfsBlobContainer$6.doInHdfs(HdfsBlobContainer.java:121)  
at org.elasticsearch.hadoop.hdfs.blobstore.HdfsBlobContainer$6.doInHdfs(HdfsBlobContainer.java:118)  
at org.elasticsearch.repositories.hdfs.SecurityUtils$1.run(SecurityUtils.java:42)  
at java.security.AccessController.doPrivileged(Native Method)  
at org.elasticsearch.repositories.hdfs.SecurityUtils.execute(SecurityUtils.java:39)  
at org.elasticsearch.repositories.hdfs.SecurityUtils.execute(SecurityUtils.java:34)  
at org.elasticsearch.hadoop.hdfs.blobstore.HdfsBlobContainer.writeBlob(HdfsBlobContainer.java:118)  
at org.elasticsearch.repositories.blobstore.BlobStoreRepository.startVerification(BlobStoreRepository.java:642)  
... 14 more

Elastic version: 2.3.5  
elasticsearch-repository-hdfs 2.3.5

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 19, 2018, 10:15am UTC](https://discuss.elastic.co/t/hdfs-respository-issue/116465/3 "2018-02-19T10:15:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
