# Logstash output S3 performance tunning

**URL:** <https://discuss.elastic.co/t/logstash-output-s3-performance-tunning/360640>\
**Category:** Logstash\
**Created:** [May 31, 2024, 5:06pm UTC](https://discuss.elastic.co/t/logstash-output-s3-performance-tunning/360640 "2024-05-31T17:06:38Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Quan\_Le\_H\_i](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/quan_le_h_i/32/134975_2.png) [@Quan\_Le\_H\_i](https://discuss.elastic.co/u/Quan_Le_H_i)\
**Post date:** [May 31, 2024, 5:06pm UTC](https://discuss.elastic.co/t/logstash-output-s3-performance-tunning/360640/1 "2024-05-31T17:06:38Z")

</div>

I have logstash server read events from input kafka and output to S3.

My logstash pipeline have set pipeline.worker to 1 to set event in same order when write to file.

After change other config such as pipeline.batchsize, output s3 upload\_workers\_count, i monitor message comsume in kafka topic alway around 10k event per second regardless of my logstash pipeline config changes.

I dont know what cause event consume rate is the same. Any one can help me.

I want to tunning performance of pipeline send log to S3.

My logstash server have 8c32g.  
logstashJavaOpts: "-Xmx22g -Xms22g"  
This is my logstash pipeline config :

```auto
output.s3 
          rotation_strategy => "size"
          size_file => 104857600
          codec => json_lines
          encoding => gzip
          upload_workers_count => 16
          upload_queue_size => 2

```