HI friends. I use an ELK stack for weeks a a test. All the stack is in version 5.1.1, excepting Logstash in v4.
Kafka is in version 0.10.0.1
After the upgrade, my old conf file isn't working.
Old conf :
input {
kafka {
zk_connect => ["192.168.18.15:2181"]
group_id => "logstash-application"
topic_id => "ActiveDirectory-Application-Logs"
reset_beginning => "false"
consumer_threads => 1
codec => json {}
}
}
output {
elasticsearch {
user => logstash_internal
password => xxxxxxxx
hosts => ["192.168.18.15:9200"]
index => "logstash-application"}
stdout {}
}
I made the changes
new conf:
input {
kafka {
bootstrap_servers => ["192.168.18.15:2181"]
group_id => "logstash-application"
topics => "ActiveDirectory-Application-Logs"
consumer_threads => 1
codec => json {}
}
}
output {
elasticsearch {
user => logstash_internal
password => xxxxxxx
hosts => ["192.168.18.15:9200"]
index => "logstash-application"}
stdout {}
}
When I lanch the conf file by "./logstash --path.settings /etc/logstash -f /etc/logstash/conf.d/logstash-application.conf " and nothing works.
in the /var/log/logstash/logstash-plain.log I have that error
[2017-01-12T09:46:51,750][WARN ][org.apache.kafka.clients.NetworkClient] Bootstrap broker 192.168.18.15:2181 disconnected
[2017-01-12T09:46:51,814][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>#<URI::HTTP:0x4338b92c URL:http://~hidden~:~hidden~@192.168.18.15:9200>}
and the log loops on the message "Bootstrap broker 192.168.18.15:2181 disconnected"
Thanks for your help. There are too many changes with v5.
Fayce