# Can Logstash pull gzipped files from s3

**URL:** <https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412>\
**Category:** Logstash\
**Created:** [January 21, 2018, 11:41pm UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412 "2018-01-21T23:41:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![red888](https://avatars.discourse-cdn.com/v4/letter/r/ecae2f/32.png) [@red888](https://discuss.elastic.co/u/red888)\
**Post date:** [January 21, 2018, 11:41pm UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412/1 "2018-01-21T23:41:11Z")

</div>

I have gzipped files on S3 I want to push into ES.

there is an S3 input plugin: [https://www.elastic.co/guide/en/logstash/current/plugins-inputs-s3.html](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-s3.html)

There is a gzip input plugin: [https://www.elastic.co/guide/en/logstash/current/plugins-codecs-gzip\_lines.html](https://www.elastic.co/guide/en/logstash/current/plugins-codecs-gzip_lines.html)

Is there a way to chain input plugins together? So the S3 input copies it locally and the gzip input unzips, groks, and pushes into ES?

---

<div class="post-metadata">

**Author:** ![Sjaak01](https://avatars.discourse-cdn.com/v4/letter/s/73ab20/32.png) [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Post date:** [January 22, 2018, 4:37am UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412/2 "2018-01-22T04:37:49Z")

</div>

No need, the s3 input can handle .gz files.

> [@](#):
>
> Description  
> edit
> 
> Stream events from files from a S3 bucket.
> 
> Each line from each file generates an event. **Files ending in .gz are handled as gzip’ed files**.

> **[S3 input plugin | Logstash Reference \[8.11\] | Elastic](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-s3.html)**

---

<div class="post-metadata">

**Author:** ![red888](https://avatars.discourse-cdn.com/v4/letter/r/ecae2f/32.png) [@red888](https://discuss.elastic.co/u/red888)\
**Post date:** [January 24, 2018, 5:29pm UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412/3 "2018-01-24T17:29:45Z")

</div>

oh wow that awesome. When it says "are handled as gzip’ed files"- this means i don't have to do anything special right? I can treat my gzipped files like regular files and grok the contents and the plugin unzips them for me transparently?

---

<div class="post-metadata">

**Author:** ![Sjaak01](https://avatars.discourse-cdn.com/v4/letter/s/73ab20/32.png) [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Post date:** [January 24, 2018, 11:42pm UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412/4 "2018-01-24T23:42:16Z")

</div>

You don't have to do anything, Logstash handles it all for you. I'm doing the same thing with .gz logs pulled from my S3.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 21, 2018, 11:42pm UTC](https://discuss.elastic.co/t/can-logstash-pull-gzipped-files-from-s3/116412/5 "2018-02-21T23:42:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.