Logstash needs restarting ,once kafka is down and live back again


(Pratheek ) #1

Currently we are facing some issues with logstash .When kafka is down and back live after sometime,logstash is not resuming to get data from the kafka topic ,its still throwing some errors and resumes loading data only when logstash instance is restarted.

Is this normal? ,or am missing anything in the config

input {
kafka {
bootstrap_servers => "xxxxxx"
topics => "abc"
group_id => "sample"
consumer_threads => 4
key_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
value_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
codec => avro {
schema_uri => "xyz.avsc"
tag_on_failure => true
}
}
}


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.