my Logstash configuration files with kafka input and output plugin is working fine individually. when im trying to start logstash having single configuration file using pipeline it is also working. But if i have multiple configuration files and start my logstash using pipeline it is not working as expected.
<input {
kafka{
client_id => 'customer'
auto_offset_reset => 'latest'
consumer_threads => 1
topics => ['nexusrouter_input']
}
}
filter{
grok{
......}
}
output {
kafka {
client_id => 'customer'
codec => "json"
topic_id => 'nexusrouter_output'
}
}
I have multiple configuration files in the same format. All configuration files have same input and output kafka topics.