# AWS S3 snapshot not storing the file, but should work as per the logs

**URL:** <https://discuss.elastic.co/t/aws-s3-snapshot-not-storing-the-file-but-should-work-as-per-the-logs/83212>\
**Category:** Elasticsearch\
**Created:** [April 21, 2017, 1:15pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-not-storing-the-file-but-should-work-as-per-the-logs/83212 "2017-04-21T13:15:24Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jayanna\_Hallur](https://avatars.discourse-cdn.com/v4/letter/j/a4c791/32.png) [@Jayanna\_Hallur](https://discuss.elastic.co/u/Jayanna_Hallur)\
**Post date:** [April 21, 2017, 1:15pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-not-storing-the-file-but-should-work-as-per-the-logs/83212/1 "2017-04-21T13:15:24Z")

</div>

root@ip-205-2-177:~# /usr/share/elasticsearch/bin/elasticsearch -version  
Version: 5.2.2, Build: f9d9b74/2017-02-24T17:26:45.835Z, JVM: 1.8.0\_73  
root@ip-205-2-177:~#

My ES cluster is up and running fine. I want validate the snapshot to S3. Hence as per the steps mentioned in  
[https://www.elastic.co/guide/en/elasticsearch/plugins/5.2/repository-s3.html](https://www.elastic.co/guide/en/elasticsearch/plugins/5.2/repository-s3.html) , I downloaded the repository-s3-5.2.2.zip file and installed with the command (as root user)  
==\>\> /usr/share/elasticsearch/bin/elasticsearch-plugin install file:///root/repository-s3-5.2.2.zip

The below command works fine:  
PUT \_snapshot/emmo\_elasticsearch\_backup\_data\_dev\_region?verify=false  
{  
"type": "s3",  
"settings": {  
"bucket": "emmo-elasticsearch-backup-data-dev",  
"region": "us-east",  
"server\_side\_encryption": true  
}  
}

The below command returns name of all master nodes (2) and data nodes (3)  
POST /\_snapshot/emmo\_elasticsearch\_backup\_data\_dev\_region/\_verify

My elasticasearch.yml  
root@ip-205-2-177:~# cat /etc/elasticsearch/elasticsearch.yml  
[cluster.name](http://cluster.name): horiz\_dev\_escluster1  
[node.name](http://node.name): 10.205.2.177  
node.master: false  
node.data: true  
node.ingest: true  
bootstrap.memory\_lock: true  
network.host: 127.0.0.1,10.205.2.177  
http.port: 8089  
bootstrap.seccomp: false  
discovery.zen.ping.unicast.hosts: [[elastic-m-dev1-nd1-e.clouddqt.capitalone.com](http://elastic-m-dev1-nd1-e.clouddqt.capitalone.com),[elastic-m-dev1-nd2-e.clouddqt.capitalone.com](http://elastic-m-dev1-nd2-e.clouddqt.capitalone.com),[elastic-m-dev1-nd3-e.clouddqt.capitalone.com](http://elastic-m-dev1-nd3-e.clouddqt.capitalone.com) ]  
discovery.zen.minimum\_master\_nodes: 2  
discovery.zen.master\_election.ignore\_non\_master\_pings: true  
discovery.zen.fd.ping\_timeout: 120s  
action.destructive\_requires\_name: true  
cluster.routing.allocation.same\_shard.host: true  
indices.fielddata.cache.size: 20%  
indices.breaker.fielddata.limit: 30%  
indices.breaker.request.limit: 30%  
cluster.routing.allocation.cluster\_concurrent\_rebalance: 4  
thread\_pool.bulk.queue\_size: 5000  
discovery.zen.ping\_timeout: 6s  
discovery.zen.commit\_timeout: 60s  
path.data: /opt/elasticsearch  
path.repo: /opt/elasticsearch

My EC2 instance as IAM ROLE with FULL S3 access. From AWS CLI, I'm able to upload the file from the ES instances. All the below commands works from Ec2 instances..  
aws s3 ls  
aws s3 cp aaa.txt s3://

When execute the snapcommand PUT command which is mentioned above,  
the log indicates PUT is success.. but after few lines..its says HEAD on the same path and says 404 (Not Found)..

---

<div class="post-metadata">

**Author:** ![Igor\_Motov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/igor_motov/32/45193_2.png) [@Igor\_Motov](https://discuss.elastic.co/u/Igor_Motov)\
**Post date:** [May 1, 2017, 1:36pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-not-storing-the-file-but-should-work-as-per-the-logs/83212/2 "2017-05-01T13:36:13Z")

</div>

> [@Jayanna\_Hallur](#):
>
> When execute the snapcommand PUT command which is mentioned above,the log indicates PUT is success.. but after few lines..its says HEAD on the same path and says 404 (Not Found)..

Could you show the exact commands that you are executing and exact errors that you are getting back?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 29, 2017, 1:48pm UTC](https://discuss.elastic.co/t/aws-s3-snapshot-not-storing-the-file-but-should-work-as-per-the-logs/83212/3 "2017-05-29T13:48:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.