Hi everyone,
I'm currently dealing with an error in logstash. Sometimes when I launch Logstash , It doesn't process some data and this error appears :
[INFO ] 2020-10-25 13:48:52.328 [[main]<file] readfile - buffer_extract: a delimiter can't be found in current chunk, maybe there are no more delimiters or the delimiter is incorrect or the text before the delimiter, a 'line', is very large, if this message is logged often try increasing the `file_chunk_size` setting. {"delimiter"=>"\n", "read_position"=>72000000, "bytes_read_count"=>2123, "last_known_file_size"=>72002123, "file_path"=>"/tmp/folder_data/file-1"}
I'm using the file input plugin with this configuration :
input
{
file
{
path => ["/tmp/folder_data/*"]
start_position => "beginning"
sincedb_path => "/dev/null"
file_chunk_size => 8000000
mode => "read"
close_older => "3 hour"
file_completed_action => "log_and_delete"
file_completed_log_path => "/tmp/file_logstash.log"
}
}
I try to increase the size of the file_chunck_size but the error still happen. I already read those :
Unfortunately there is sometimes no answer or the error is not the same...
If you have a solution or a way to avoid this error, it will really help me.
Thanks.
Eddy