# Logstash un-gzip array log configuration

**URL:** <https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000>\
**Category:** Logstash\
**Created:** [November 23, 2018, 11:52am UTC](https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000 "2018-11-23T11:52:05Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![00a45f9a00ca005db54c](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/00a45f9a00ca005db54c/32/38003_2.png) [@00a45f9a00ca005db54c](https://discuss.elastic.co/u/00a45f9a00ca005db54c)\
**Post date:** [November 23, 2018, 11:52am UTC](https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000/1 "2018-11-23T11:52:05Z")

</div>

Hey everyone! I have logstash config, which forwards logs from RabbitMQ to elasticSearch. Something like this:

```
input {
    rabbitmq {
        ...
    }
}

filter {
    if [type] == "rabbitmq" {
        json {
            source => "message"
            target => "message"
        }
    }
}

output {
  elasticsearch {
    hosts => ["${ES_HOST}"]
    user => "${ES_USERNAME}"
    password => "${ES_PASSWORD}"
    sniffing => false
    index => "kit_events-%{[message][elasticsearch][index]}"
  }
}

```

And we were forced to compress logs on a fly, because they are spending too much traffic. Logs were moved into array and gzipped. What is the correct way of configuring un-gzipping and splitting array back into objects?

I did some research and found out that there is gzip\_lines plugin and something on Ruby(?) to parse array, but I failed to implement it. Did anyone make something like this before?

---

<div class="post-metadata">

**Author:** ![Eniqmatic](https://avatars.discourse-cdn.com/v4/letter/e/ea5d25/32.png) [@Eniqmatic](https://discuss.elastic.co/u/Eniqmatic)\
**Post date:** [November 23, 2018, 11:55am UTC](https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000/2 "2018-11-23T11:55:13Z")

</div>

Not really sure I understand fully, but where are they zipped? On the source?

---

<div class="post-metadata">

**Author:** ![00a45f9a00ca005db54c](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/00a45f9a00ca005db54c/32/38003_2.png) [@00a45f9a00ca005db54c](https://discuss.elastic.co/u/00a45f9a00ca005db54c)\
**Post date:** [November 23, 2018, 12:12pm UTC](https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000/3 "2018-11-23T12:12:58Z")

</div>

Yea, python script sends data to RabbitMQ. And this data will be gzipped before sending.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 21, 2018, 12:13pm UTC](https://discuss.elastic.co/t/logstash-un-gzip-array-log-configuration/158000/4 "2018-12-21T12:13:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.