Logstash problems after upgrade


(Grenouille06) #1

HI friends. I use an ELK stack for weeks a a test. All the stack is in version 5.1.1, excepting Logstash in v4.

Kafka is in version 0.10.0.1

After the upgrade, my old conf file isn't working.

Old conf :

input {
kafka {
zk_connect => ["192.168.18.15:2181"]
group_id => "logstash-application"
topic_id => "ActiveDirectory-Application-Logs"
reset_beginning => "false"
consumer_threads => 1
codec => json {}
}
}

output {
elasticsearch {
user => logstash_internal
password => xxxxxxxx
hosts => ["192.168.18.15:9200"]
index => "logstash-application"}
stdout {}
}

I made the changes

new conf:

input {
kafka {
bootstrap_servers => ["192.168.18.15:2181"]
group_id => "logstash-application"
topics => "ActiveDirectory-Application-Logs"
consumer_threads => 1
codec => json {}
}
}

output {
elasticsearch {
user => logstash_internal
password => xxxxxxx
hosts => ["192.168.18.15:9200"]
index => "logstash-application"}
stdout {}
}

When I lanch the conf file by "./logstash --path.settings /etc/logstash -f /etc/logstash/conf.d/logstash-application.conf " and nothing works.

in the /var/log/logstash/logstash-plain.log I have that error

[2017-01-12T09:46:51,750][WARN ][org.apache.kafka.clients.NetworkClient] Bootstrap broker 192.168.18.15:2181 disconnected
[2017-01-12T09:46:51,814][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>#<URI::HTTP:0x4338b92c URL:http://~hidden~:~hidden~@192.168.18.15:9200>}

and the log loops on the message "Bootstrap broker 192.168.18.15:2181 disconnected"

Thanks for your help. There are too many changes with v5.

Fayce


(Mark Walkom) #2

There is no version 4 of Logstash, what version are you running?


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.