I noticed that I stopped receiving logs in logstash from the one host I have running filebeat.
If I tail the logs for filebeat and I'm seeing these messages repeating over and over again:
2016-02-10T11:14:21-05:00 DBG Try to publish %!s(int=40) events to logstash with window size %!s(int=1)
2016-02-10T11:14:21-05:00 DBG %!s(int=1) events out of %!s(int=40) events sent to logstash. Continue sending ...
2016-02-10T11:14:21-05:00 DBG Try to publish %!s(int=39) events to logstash with window size %!s(int=1)
2016-02-10T11:14:21-05:00 DBG %!s(int=1) events out of %!s(int=39) events sent to logstash. Continue sending ...
2016-02-10T11:14:21-05:00 DBG Try to publish %!s(int=38) events to logstash with window size %!s(int=1)
2016-02-10T11:14:21-05:00 DBG %!s(int=1) events out of %!s(int=38) events sent to logstash. Continue sending ...
2016-02-10T11:14:21-05:00 DBG Try to publish %!s(int=37) events to logstash with window size %!s(int=1)
2016-02-10T11:14:21-05:00 DBG %!s(int=1) events out of %!s(int=37) events sent to logstash. Continue sending ...
2016-02-10T11:14:21-05:00 DBG Try to publish %!s(int=36) events to logstash with window size %!s(int=1)
My config file is in the next post, as if I include it in this post it's too big.
Logs look like a bug recently identified in logstash output. We're in the middle of preparing a 1.1.1 version containing a fix. You can try with 1.1.1 snapshot build:
I tried the rpm snapshot of filebeat 1.1 that you pointed me to. I uninstalled the 1.0 version with a yum remove command, and then installed the one you suggested:
But as I'm tailing the logs I'm finding no change in the errors that I'm seeing:
2016-02-10T11:59:27-05:00 DBG Try to publish %!s(int=189) events to logstash with window size %!s(int=1)
2016-02-10T11:59:27-05:00 DBG %!s(int=1) events out of %!s(int=189) events sent to logstash. Continue sending ...
2016-02-10T11:59:27-05:00 DBG Try to publish %!s(int=188) events to logstash with window size %!s(int=1)
2016-02-10T11:59:27-05:00 DBG %!s(int=1) events out of %!s(int=188) events sent to logstash. Continue sending ...
2016-02-10T11:59:27-05:00 DBG Try to publish %!s(int=187) events to logstash with window size %!s(int=1)
2016-02-10T11:59:27-05:00 DBG %!s(int=1) events out of %!s(int=187) events sent to logstash. Continue sending ...
2016-02-10T11:59:27-05:00 DBG Try to publish %!s(int=186) events to logstash with window size %!s(int=1)
Not sure what to do but wait for a newer version of 1.1, I guess.
hey slight update here. I uninstalled the filebeat snapshot rpm, then purged my system of all traces of filebeat with the unix find command. Then reinstalled it. Currently it's working again with my original yaml config. Let's hope it stays working!
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.