Logstash Java Heap Error


#1

Need assistance on the below Error from logstash logs

We have enough jvm.options settings xms xmx both 8gb, memory is not getting used up. CPU is maxed then logstash will restart. Any thoughts?

[ERROR][logstash.pipeline ] Exception in pipelineworker, the pipeline stopped processing new events,
please check your filter configuration and restart Logstash. {:pipeline_id=>"main", "exception"=>"Java heap space",
"backtrace"=>["java.util.Arrays.copyOfRange(Arrays.java:3664)", "java.lang.String.(String.java:207)",
"java.nio.HeapCharBuffer.toString(HeapCharBuffer.java:567)", "java.nio.CharBuffer.toString(CharBuffer.java:1241)",
"org.jruby.RubyEncoding$UTF8Coder.decode(RubyEncoding.java:314)", "org.jruby.RubyEncoding.decodeUTF8(RubyEncoding.java:248)",
"org.jruby.runtime.Helpers.decodeByteList(Helpers.java:2659)", "org.jruby.RubyString.decodeString(RubyString.java:761)",
"org.jruby.RubyString.toString(RubyString.java:752)", "org.logstash.Javafier.lambda$initConverters$1(Javafier.java:68)",
"org.logstash.Javafier$$Lambda$215/1615191375.convert(Unknown Source)", "org.logstash.Javafier.deep(Javafier.java:37)",
"org.logstash.Event.getField(Event.java:131)", "org.logstash.StringInterpolation.evaluate(StringInterpolation.java:53)",
"org.logstash.Event.sprintf(Event.java:261)", "org.logstash.ext.JrubyEventExtLibrary$RubyEvent.ruby_sprintf(JrubyEventExtLibrary.java:166)",
"org.logstash.ext.JrubyEventExtLibrary$RubyEvent$INVOKER$i$1$0$ruby_sprintf.call(JrubyEventExtLibrary$RubyEvent$INVOKER$i$1$0$ruby_sprintf.gen)",
"org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:161)",
"usr.share.logstash.logstash_minus_core.lib.logstash.util.decorators.invokeOther0:sprintf(/usr/share/logstash/logstash-core/lib/logstash/util/decorators.rb:19)",
"usr.share.logstash.logstash_minus_core.lib.logstash.util.decorators.RUBY$block$add_fields$2(/usr/share/logstash/logstash-core/lib/logstash/util/decorators.rb:19)",
"java.lang.invoke.LambdaForm$DMH/842918769.invokeStatic_L8_L(LambdaForm$DMH)",
"java.lang.invoke.LambdaForm$MH/1863932867.invokeExact_MT(LambdaForm$MH)",
"org.jruby.runtime.CompiledIRBlockBody.yieldDirect(CompiledIRBlockBody.java:156)", "org.jruby.runtime.BlockBody.yield(BlockBody.java:114)",
"org.jruby.runtime.Block.yield(Block.java:165)", "org.jruby.RubyArray.each(RubyArray.java:1734)",
"org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)",
"org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:139)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:145)",
"usr.share.logstash.logstash_minus_core.lib.logstash.util.decorators.invokeOther18:each(/usr/share/logstash/logstash-core/lib/logstash/util/decorators.rb:18)",
"usr.share.logstash.logstash_minus_core.lib.logstash.util.decorators.RUBY$block$add_fields$1(/usr/share/logstash/logstash-core/lib/logstash/util/decorators.rb:18)",
"java.lang.invoke.LambdaForm$DMH/1545949982.invokeStatic_L8_L(LambdaForm$DMH)"],
:thread=>"#<Thread:0x3a969fe8@/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:245 sleep>"}


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.