# Export From elasticsearch to S3

**URL:** <https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112>\
**Category:** Logstash\
**Created:** [May 31, 2018, 10:08pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112 "2018-05-31T22:08:37Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![praveen.vemuri](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@praveen.vemuri](https://discuss.elastic.co/u/praveen.vemuri)\
**Post date:** [May 31, 2018, 10:08pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/1 "2018-05-31T22:08:38Z")

</div>

Hi,

What is the best way to export raw data from elasticsearch to s3?

i read about elasticdump and there we have to download to local filesystem and then copy to s3?

---

<div class="post-metadata">

**Author:** ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Post date:** [June 1, 2018, 2:12am UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/2 "2018-06-01T02:12:13Z")

</div>

Have you tried using logstash and output to s3? [https://www.elastic.co/guide/en/logstash/current/plugins-outputs-s3.html](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-s3.html)

You can use elasticsearch as your input source

---

<div class="post-metadata">

**Author:** ![praveen.vemuri](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@praveen.vemuri](https://discuss.elastic.co/u/praveen.vemuri)\
**Post date:** [June 1, 2018, 2:21am UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/3 "2018-06-01T02:21:46Z")

</div>

Hi Wayne, Thanks for your response..

I tried it once couple months back. but it is restarting randomly and starting the export from begining again. so i didn't try it now in 6.2.4. i will try it now and let you know.

---

<div class="post-metadata">

**Author:** ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Post date:** [June 1, 2018, 12:48pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/4 "2018-06-01T12:48:12Z")

</div>

Praveen,

Do you have a sincedb configured and what version did you have that problem with? I recall having similar issue on restarts but an update solved it.

Wayne

---

<div class="post-metadata">

**Author:** ![praveen.vemuri](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@praveen.vemuri](https://discuss.elastic.co/u/praveen.vemuri)\
**Post date:** [June 4, 2018, 5:20pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/5 "2018-06-04T17:20:45Z")

</div>

Hi Wayne, I just tried with logstash 6.2.4 and it restarted. i tried to configure sincedb\_path but it says unknown setting. As elasticsearch depends on scroll id. is it configurable for elasticsearch input?

[LogStash::Runner] elasticsearch - Unknown setting 'sincedb\_path' for elasticsearch

---

<div class="post-metadata">

**Author:** ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Post date:** [June 4, 2018, 5:36pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/6 "2018-06-04T17:36:23Z")

</div>

Sorry - my bad. Since is for input not output.

Can you put in debug mode and provide output here? Also, this needs to move from Elasticsearch to Logstash forum. You'll get better responses

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 2, 2018, 5:36pm UTC](https://discuss.elastic.co/t/export-from-elasticsearch-to-s3/134112/7 "2018-07-02T17:36:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
