Currently we are facing some issues with logstash .When kafka is down and back live after sometime,logstash is not resuming to get data from the kafka topic ,its still throwing some errors and resumes loading data only when logstash instance is restarted.
Is this normal? ,or am missing anything in the config
input {
kafka {
bootstrap_servers => "xxxxxx"
topics => "abc"
group_id => "sample"
consumer_threads => 4
key_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
value_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
codec => avro {
schema_uri => "xyz.avsc"
tag_on_failure => true
}
}
}