# Zip file pass through

**URL:** <https://discuss.elastic.co/t/zip-file-pass-through/171008>\
**Category:** Logstash\
**Created:** [March 6, 2019, 12:37am UTC](https://discuss.elastic.co/t/zip-file-pass-through/171008 "2019-03-06T00:37:15Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![kharvey](https://avatars.discourse-cdn.com/v4/letter/k/d07c76/32.png) [@kharvey](https://discuss.elastic.co/u/kharvey)\
**Post date:** [March 6, 2019, 12:37am UTC](https://discuss.elastic.co/t/zip-file-pass-through/171008/1 "2019-03-06T00:37:15Z")

</div>

This may be a strange request, but is there a way that I can use Filebeat / Logstash to do a straight pass through of a zip file?

I have a site that has 10's of gigs of log files that I want to process a day, but they are on a slow connection. So I would like to zip the all log files together, then at the end of the day, I wanted Filebeat to take that zip file and send it up to my Logstash server to save it as a file.  
Once I have the zip file on the Logstash server, I would probably use cron or something to unzip the files, and then do a local Filebeat send on the Logstash server to process the files.  
Due to latency issues, I cannot stream the files all day long so that I am only doing a differential on the log files.

I know there are other ways to get zip files onto a server, but since I already have a pipeline setup for logs, I thought that I would try and use Filebeat and Logstash to handle that piece as well.

I attempted to create a pipeline to handle this:  
Filebeat.yml

```auto
- type: log
  enabled: true
  paths:
    - /root/logs.zip
output.logstash:
  hosts: ["10.1.2.143:5044"]
```

Logstash conf:

```auto
input {
  pipeline {
    address => zip_file
  }
}

output {
        file {
                path => "/root/zip_test.zip"
        }
}
```

When I run through this setup, it takes a 1.3 MB zip file, then it processes the zip file and spits out an 8.3 MB zip file. It's actually kind of cool, it json'ifies my zip file, it adds a bunch of tags, and uses the binary from the zip as the message.

Does anyone have any suggestions?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 3, 2019, 12:37am UTC](https://discuss.elastic.co/t/zip-file-pass-through/171008/2 "2019-04-03T00:37:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.