Logstash drop based on size

Elastic Stack Logstash
1

Hi all,

Is it possible to drop a message based on it's size (ex: above 1 MB)?

I'm reading from tcp port and writing into Kafka topic.
All messages bigger then 1 MB give errors similar to this and then logstash retry to send
it again, giving same error:

"producer send failed {:exception=>Java::JavaUtilConcurrent::ExecutionException, :message=>"org.apache.kafka.common.errors.RecordTooLargeException: The message is 8842365 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration."

Thank you

2

Answered here.

3

Thank you for your prompt reply!

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.