input { file { path => [ "${folder}\log1.txt", "${folder}\log2.txt" ... ... ... "${folder}\log1000.txt" ] } } Is there any problem with this kind of configuration to have logstash put 100+ file locations as input paths? Should I be reducing the pipeline.batch.size or something else to re…

Many files in input path

safhw91 July 17, 2018, 5:35am 4

FYI see Logstash constantly losing connection to Elastic for how I solved it.

Topic		Replies	Views
Logstash file input not loading Logstash	1	469	March 21, 2017
Logstash "input" performance? Logstash	9	1809	July 6, 2017
Logstash file input plugin picks different files other than specified path Logstash	1	149	May 31, 2023
Logstash file input Logstash	1	194	June 5, 2023
Logstash failing with "ERROR::EMFILE- Too many open files" Logstash	16	4365	September 5, 2019

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Many files in input path

Related Topics