Logstash5.4 output kafka problem


(Chao) #1

kafka 0.9.0.1
centos 6.5
logstash 5.4

with the following config, logstash2.4 can output data to kafka topic, but failed with logatsh5.4.
i don't know why.


input{
file {
path => "/home/wangchao/api2.log"
start_position => "end"
}
}

output {
kafka {
bootstrap_servers => "test:9092"
codec => plain {
format => "%{message}"
}
topic_id => "interfaceAccess_API"
}
}


(Chao) #2

[2017-05-12T17:53:28,283][DEBUG][logstash.inputs.file ] each: file grew: /home/wangchao/api2.log: old size 190, new size 199
[2017-05-12T17:53:28,284][DEBUG][logstash.inputs.file ] Received line {:path=>"/home/wangchao/api2.log", :text=>"xxxxx222"}
[2017-05-12T17:53:28,306][DEBUG][logstash.inputs.file ] writing sincedb (delta since last write = 1494582808)
[2017-05-12T17:53:28,312][DEBUG][logstash.pipeline ] filter received {"event"=>{"path"=>"/home/wangchao/api2.log", "@timestamp"=>2017-05-12T09:53:28.303Z, "@version"=>"1", "host"=>"0.0.0.0", "message"=>"xxxxx222"}}
[2017-05-12T17:53:28,316][DEBUG][logstash.pipeline ] output received {"event"=>{"path"=>"/home/wangchao/api2.log", "@timestamp"=>2017-05-12T09:53:28.303Z, "@version"=>"1", "host"=>"0.0.0.0", "message"=>"xxxxx222"}}
[2017-05-12T17:53:32,204][DEBUG][logstash.pipeline ] Pushing flush onto pipeline


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.