Readfile - buffer_extract error: a delimiter can't be found

Hi everyone,

I'm currently dealing with an error in logstash. Sometimes when I launch Logstash , It doesn't process some data and this error appears :

[INFO ] 2020-10-25 13:48:52.328 [[main]<file] readfile - buffer_extract: a delimiter can't be found in current chunk, maybe there are no more delimiters or the delimiter is incorrect or the text before the delimiter, a 'line', is very large, if this message is logged often try increasing the `file_chunk_size` setting. {"delimiter"=>"\n", "read_position"=>72000000, "bytes_read_count"=>2123, "last_known_file_size"=>72002123, "file_path"=>"/tmp/folder_data/file-1"}

I'm using the file input plugin with this configuration :

input 
{
	file 
	{
		path => ["/tmp/folder_data/*"]
		start_position => "beginning"
		sincedb_path => "/dev/null"
		file_chunk_size => 8000000
		mode => "read"
		close_older => "3 hour"
		file_completed_action => "log_and_delete"
		file_completed_log_path => "/tmp/file_logstash.log"
	}
}

I try to increase the size of the file_chunck_size but the error still happen. I already read those :

Unfortunately there is sometimes no answer or the error is not the same...

If you have a solution or a way to avoid this error, it will really help me.

Thanks.
Eddy

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.