Logstash stops often


(marc) #1

Hi,

Since a long time ago my logstash is stopping. The log shows this error:

{:timestamp=>"2016-12-14T23:12:28.910000+0100", :message=>"Exception in filterworker, the pipeline stopped processing new events, please check your filter configuration and restart Logstash
.", "exception"=>#<RuntimeError: can't add a new key into hash during iteration>, "backtrace"=>["org/jruby/RubyHash.java:992:in []='", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash- filter-throttle-2.0.2/lib/logstash/filters/throttle.rb:186:infilter'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/filters/base.rb:152:in multi_filt er'", "org/jruby/RubyArray.java:1613:ineach'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/filters/base.rb:149:in multi_filter'", "(eval):22760:in
cond_func_1157'", "org/jruby/RubyArray.java:1613:in each'", "(eval):22757:incond_func_1157'", "(eval):22783:in cond_func_1156'", "org/jruby/RubyArray.java:1613:ineach'", "(eval):22780
:in cond_func_1156'", "(eval):3028:infilter_func'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/pipeline.rb:219:in filterworker'", "/opt/logstash/v endor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/pipeline.rb:154:instart_filters'"], :level=>:error}
{:timestamp=>"2016-12-14T23:12:28.910000+0100", :message=>"Exception in filterworker, the pipeline stopped processing new events, please check your filter configuration and restart Logstash
.", "exception"=>#<NoMethodError: undefined method []' for nil:NilClass>, "backtrace"=>["/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-throttle-2.0.2/lib/logstash/filters/thro ttle.rb:196:infilter'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/filters/base.rb:152:in multi_filter'", "org/jruby/RubyArray.java:1613:ineach'"
, "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/filters/base.rb:149:in multi_filter'", "(eval):22760:incond_func_1157'", "org/jruby/RubyArray.java:161
3:in each'", "(eval):22757:incond_func_1157'", "(eval):22783:in cond_func_1156'", "org/jruby/RubyArray.java:1613:ineach'", "(eval):22780:in cond_func_1156'", "(eval):3028:infilter_
func'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0-java/lib/logstash/pipeline.rb:219:in filterworker'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.0.0 -java/lib/logstash/pipeline.rb:154:instart_filters'"], :level=>:error}

I understand that the problem deals with throttle.
What can i do to fix this? it is productibeless as i should restart logstash to make it work again.

My cnf file is huge, so if you need let me know where to upload it.

Thanks


(Mark Walkom) #2

What does your config look like?


(marc) #3

http://pastebin.com/znbUE2MB


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.