# How to control Logstash multiple output rate

**URL:** <https://discuss.elastic.co/t/how-to-control-logstash-multiple-output-rate/245224>\
**Category:** Logstash\
**Created:** [August 17, 2020, 11:15am UTC](https://discuss.elastic.co/t/how-to-control-logstash-multiple-output-rate/245224 "2020-08-17T11:15:10Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![vaishno.avi](https://avatars.discourse-cdn.com/v4/letter/v/f0a364/32.png) [@vaishno.avi](https://discuss.elastic.co/u/vaishno.avi)\
**Post date:** [August 17, 2020, 11:15am UTC](https://discuss.elastic.co/t/how-to-control-logstash-multiple-output-rate/245224/1 "2020-08-17T11:15:10Z")

</div>

Hello,

I am using logstash with multiple output, with the below config

```auto
    if [channel] == "test" {
          elasticsearch {
            hosts => ["elk_url"]
            index => "logs-%{+YYYY.MM.dd}"
          }
          file {
            codec => json_lines
            path => "/tmp/logs/test.log"
            flush_interval => 0
          }

```

While doing so, I can see all events shipped to elastic/kibana, where as when i try to validate the same on the test.log, I see events are missing

My test.log is on a nfs share.

I see that the nds share is the bottelneck here. Is there a way to control the rate at which logstash sends output while using file module?  
I have tried pipeline.batch.size

- tested with 500 : still losing data on share
- tested with 200 : still losing data on share
- tested with 125 : still losing data on share
- tested with 60 : still losing data on share
- tested with 1 : still losing date on share, the rate at which events are sent to both elastic and nfs share is also very slow.

```auto
Logstash config : 16 worker , 4gb heap 
Filebeat config : 4096 mem.events, 2048 flush.min_events, 8 workers, 2048 bulk_max_size

```

Regards  
Ashish

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 14, 2020, 11:15am UTC](https://discuss.elastic.co/t/how-to-control-logstash-multiple-output-rate/245224/2 "2020-09-14T11:15:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.