Deb
August 28, 2016, 4:56am
3
Logstash 1.5.3
Kafka 0.8.
ES - 1.7.1
My pipeline looks like below:-
Multiple LF --- Logstash Collector --- Kafka---- Logstash Indexer --- ES
Cluster.
I am seeing the problem in logstash-collector.
Just to add in preparation for moving to beats I tried upgrading to
logstash 2.3.4. But that started giving some other issue:-
I modified my output plugin as follows:-
output {
if [env] == "prod" or [env] == "common" {
stdout { codec => rubydebug }
}
}
Logstash log said:-
Pipeline main started {:file=>"logstash/agent.rb",:line=>"473", :method=>"start_pipeline"}
Also I started getting data on the stdout.
We are using transport protocol so we are using elasticsearch_java output.
So at this point I am stuck with LSF.