I want to know what the flush_size and idle_flush_time has been changed to

Elastic Stack Logstash
1 
	elasticsearch { 
					hosts => localhost	  	
					index => "logstash(%{+YYYY.MM.dd})"  
					document_type =>"logstash"
                    flush_size=>1000 
                    idle_flush_time=>15
					}

it didn‘t work
i use logstash-6.1.3

2

Those parameters have been deprecated as output plugins are handled differently now by Logstash. Processing is now done in batches, and output is handled per batch. An output plugin is therefore no longer allowed to accumulate events across multiple batches, which is what I believe these parameters used to control.

3

how can i know how many events in a batch ，how does logstash output work ,i don't want logstash report errors because i upload many log the same time

4

The size of internal batches are governed by the pipeline.batch.size configuration parameter. How to tune this is covered in the documentation. Unless you create additional events within a batch, e.g. through the clone filter, this is the maximum bulk size sent to Elasticsearch, as each batch is processed separately.

1 Like
5

thank you~

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.