# Gz file handling by interaction as XML files

**URL:** <https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002>\
**Category:** Logstash\
**Created:** [October 29, 2021, 1:25pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002 "2021-10-29T13:25:20Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)\
**Post date:** [October 29, 2021, 1:25pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/1 "2021-10-29T13:25:20Z")

</div>

Hi  
How Can I configure input for reading per only one file. It is very important that logstash reads one file at a time as soon as it finishes parsing it and reads another one. This is related to the xml structure.  
I have tried something like this

```auto

input {
    file {
        path =>"/data/data_1/A20211029*.gz"
        codec => multiline { pattern => "</measCollecFile>" negate => true what => next max_lines => 300000 max_bytes => 6000000 auto_flush_interval => 1 }
        start_position => "beginning"
        sincedb_path => "/dev/null"
        max_open_files => 1
        type => "xml"
    }
}

```

but **max\_open\_files** didn't cover above my requirements.

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [October 29, 2021, 10:47pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/2 "2021-10-29T22:47:01Z")

</div>

You cannot read gzipped files in tail mode.

The file input [documentation](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html#plugins-inputs-file-file_chunk_count) says it will read up to 4 exabytes from each file before it processes the next. It should be working the way you want.

---

<div class="post-metadata">

**Author:** ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)\
**Post date:** [November 3, 2021, 6:49pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/3 "2021-11-03T18:49:56Z")

</div>

ok, so other things can we set up the pauseinterval between EOF and start to read next one?

---

<div class="post-metadata">

**Author:** ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)\
**Post date:** [November 3, 2021, 9:57pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/4 "2021-11-03T21:57:11Z")

</div>

#### `stat_interval` I'm right?

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [November 3, 2021, 11:09pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/5 "2021-11-03T23:09:25Z")

</div>

I'm sorry, I really do not understand what you are trying to do.

---

<div class="post-metadata">

**Author:** ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)\
**Post date:** [November 3, 2021, 11:57pm UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/6 "2021-11-03T23:57:30Z")

</div>

I wanted to introduce an interval for loading a files

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [November 4, 2021, 1:09am UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/7 "2021-11-04T01:09:42Z")

</div>

stat\_interval tells the input how often to wait between checks for new data. The wait and the time taken to read the files determine the actual time between checks.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 2, 2021, 1:10am UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002/8 "2021-12-02T01:10:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.