# Logstash number of threads keeps increasing until crash **URL:** \ **Category:** Logstash\ **Created:** [September 1, 2022, 4:14pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463 "2022-09-01T16:14:09Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![Alain\_Bod](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/alain_bod/32/77345_2.png) [@Alain\_Bod](https://discuss.elastic.co/u/Alain_Bod)\ **Post date:** [September 1, 2022, 4:14pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/1 "2022-09-01T16:14:09Z")
Hi, I'm testing the following pipeline (stack version 8.4.1): ```auto input { google_cloud_storage {...} } filter {csv {...} mutate {...} } output { elasticsearch {...} } ``` with a large number of events (3M+). After a few minutes, the number of threads increases until more than 18700 and logstash crashes with: ```auto [689.902s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: 0k, detached. [689.902s][warning][os,thread] Failed to start the native thread for java.lang.Thread "Ruby-0-Fiber-18666" [2022-09-01T11:52:51,964][FATAL][org.logstash.Logstash][org_dataset] uncaught error (in thread [org_dataset]>worker0) java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached ``` I've tried all recipes found related to the subject but nothing changes (not even the number of threads that triggers the crash). Has anyone a hint about the issue? Looking at the thread dump, I can see the following thread to be the one multiplying itself (in waiting state): ```auto Fiber thread for block at: uri:classloader:/jruby/kernel/enumerator.rb:62 stackTrace: java.lang.Thread.State: WAITING (parking) at jdk.internal.misc.Unsafe.park(java.base@17.0.4/Native Method) - parking to wait for <0x000000071726d660> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(java.base@17.0.4/LockSupport.java:341) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(java.base@17.0.4/AbstractQueuedSynchronizer.java:506) at java.util.concurrent.ForkJoinPool.unmanagedBlock(java.base@17.0.4/ForkJoinPool.java:3463) at java.util.concurrent.ForkJoinPool.managedBlock(java.base@17.0.4/ForkJoinPool.java:3434) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@17.0.4/AbstractQueuedSynchronizer.java:1623) at java.util.concurrent.ArrayBlockingQueue.take(java.base@17.0.4/ArrayBlockingQueue.java:420) at org.jruby.ext.fiber.FiberQueue$1.run(FiberQueue.java:55) at org.jruby.ext.fiber.FiberQueue$1.run(FiberQueue.java:52) at org.jruby.RubyThread.executeTask(RubyThread.java:1712) at org.jruby.RubyThread.executeTaskBlocking(RubyThread.java:1686) at org.jruby.ext.fiber.FiberQueue.pop(FiberQueue.java:91) at org.jruby.ext.fiber.ThreadFiber.exchangeWithFiber(ThreadFiber.java:109) at org.jruby.ext.fiber.ThreadFiber.yield(ThreadFiber.java:222) at org.jruby.ext.fiber.ThreadFiber.yield(ThreadFiber.java:229) at org.jruby.ext.fiber.ThreadFiber$INVOKER$s$yield.call(ThreadFiber$INVOKER$s$yield.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:75) at uri_3a_classloader_3a_.jruby.kernel.enumerator.invokeOther0:yield(uri:classloader:/jruby/kernel/enumerator.rb:65) at uri_3a_classloader_3a_.jruby.kernel.enumerator.RUBY$block$initialize$2(uri:classloader:/jruby/kernel/enumerator.rb:65) at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17.0.4/DirectMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x00000008012eec00.invoke(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.DelegatingMethodHandle$Holder.delegate(java.base@17.0.4/DelegatingMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x00000008012ec400.guard(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.Invokers$Holder.linkToCallSite(java.base@17.0.4/Invokers$Holder) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$method$emit_row$0(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:1122) at java.lang.invoke.LambdaForm$DMH/0x0000000801ec8c00.invokeStatic(java.base@17.0.4/LambdaForm$DMH) at java.lang.invoke.LambdaForm$MH/0x000000080128c400.invokeExact_MT(java.base@17.0.4/LambdaForm$MH) at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:165) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:185) at org.jruby.runtime.callsite.RefinedCachingCallSite.call(RefinedCachingCallSite.java:95) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.invokeOther49:emit_row(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:871) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$block$parse_quotable_loose$1(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:871) at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17.0.4/DirectMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x00000008012eec00.invoke(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.DelegatingMethodHandle$Holder.delegate(java.base@17.0.4/DelegatingMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x00000008012ec400.guard(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.Invokers$Holder.linkToCallSite(java.base@17.0.4/Invokers$Holder) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$block$each_line$1(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:52) at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17.0.4/DirectMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x0000000801ec8400.invoke(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.LambdaForm$MH/0x0000000800cad000.invokeExact_MT(java.base@17.0.4/LambdaForm$MH) at org.jruby.runtime.CompiledIRBlockBody.yieldDirect(CompiledIRBlockBody.java:151) at org.jruby.runtime.IRBlockBody.yieldSpecific(IRBlockBody.java:89) at org.jruby.runtime.Block.yieldSpecific(Block.java:166) at org.jruby.util.StringSupport.rbStrEnumerateLines(StringSupport.java:2057) at org.jruby.util.StringSupport.rbStrEnumerateLines(StringSupport.java:1958) at org.jruby.RubyString.each_line(RubyString.java:5944) at org.jruby.RubyString$INVOKER$i$each_line.call(RubyString$INVOKER$i$each_line.gen) at org.jruby.runtime.callsite.RefinedCachingCallSite.call(RefinedCachingCallSite.java:95) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:192) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.invokeOther5:each_line(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:49) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$method$each_line$0(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:49) at java.lang.invoke.LambdaForm$DMH/0x0000000801ec8000.invokeStatic(java.base@17.0.4/LambdaForm$DMH) at java.lang.invoke.LambdaForm$MH/0x000000080128c400.invokeExact_MT(java.base@17.0.4/LambdaForm$MH) at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:165) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:185) at org.jruby.runtime.callsite.RefinedCachingCallSite.call(RefinedCachingCallSite.java:95) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:192) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.invokeOther54:each_line(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:823) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$method$parse_quotable_loose$0(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:823) at java.lang.invoke.LambdaForm$DMH/0x0000000801ec7c00.invokeStatic(java.base@17.0.4/LambdaForm$DMH) at java.lang.invoke.Invokers$Holder.invokeExact_MT(java.base@17.0.4/Invokers$Holder) at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:152) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:148) at org.jruby.runtime.callsite.RefinedCachingCallSite.call(RefinedCachingCallSite.java:71) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.invokeOther26:parse_quotable_loose(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:336) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$method$parse$0(/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:336) at usr.share.logstash.vendor.jruby.lib.ruby.stdlib.csv.parser.RUBY$method$parse$0$ __VARARGS__ (/usr/share/logstash/vendor/jruby/lib/ruby/stdlib/csv/parser.rb:318) at java.lang.invoke.LambdaForm$DMH/0x0000000801ebd400.invokeStatic(java.base@17.0.4/LambdaForm$DMH) at java.lang.invoke.LambdaForm$MH/0x000000080128c400.invokeExact_MT(java.base@17.0.4/LambdaForm$MH) at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:139) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:112) at org.jruby.RubyClass.finvokeWithRefinements(RubyClass.java:512) at org.jruby.RubyBasicObject.send(RubyBasicObject.java:1733) at org.jruby.RubyBasicObject$INVOKER$i$send.call(RubyBasicObject$INVOKER$i$send.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:85) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:94) at uri_3a_classloader_3a_.jruby.kernel.enumerator.invokeOther3: __send__ (uri:classloader:/jruby/kernel/enumerator.rb:64) at uri_3a_classloader_3a_.jruby.kernel.enumerator.RUBY$block$initialize$1(uri:classloader:/jruby/kernel/enumerator.rb:64) at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17.0.4/DirectMethodHandle$Holder) at java.lang.invoke.LambdaForm$MH/0x0000000801ec5800.invoke(java.base@17.0.4/LambdaForm$MH) at java.lang.invoke.LambdaForm$MH/0x0000000800cad000.invokeExact_MT(java.base@17.0.4/LambdaForm$MH) at org.jruby.runtime.CompiledIRBlockBody.yieldDirect(CompiledIRBlockBody.java:151) at org.jruby.runtime.IRBlockBody.yieldSpecific(IRBlockBody.java:72) at org.jruby.runtime.Block.yieldSpecific(Block.java:157) at org.jruby.ext.fiber.ThreadFiber.lambda$createThread$0(ThreadFiber.java:302) at org.jruby.ext.fiber.ThreadFiber$$Lambda$1482/0x0000000801e556e0.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@17.0.4/ThreadPoolExecutor.java:1136) at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@17.0.4/ThreadPoolExecutor.java:635) at java.lang.Thread.run(java.base@17.0.4/Thread.java:833) Locked ownable synchronizers: - <0x0000000713609ab8> (a java.util.concurrent.ThreadPoolExecutor$Worker) ``` ---
**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Post date:** [September 1, 2022, 7:05pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/2 "2022-09-01T19:05:08Z")
Do you have a lot of files in the buckets of your `google_cloud_storage` input? I've had some issues with this plugin in the past if the bucket has a lot of files because it needs to list everything every time it reads from the bucket. This plugin is also has not been updated since 2019, it was developed by someone at Google, but it seens abandoned now. ---
**Author:** ![Alain\_Bod](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/alain_bod/32/77345_2.png) [@Alain\_Bod](https://discuss.elastic.co/u/Alain_Bod)\ **Post date:** [September 2, 2022, 6:52am UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/3 "2022-09-02T06:52:16Z")
There's only one file but it is 3,4Gb and 30M lines. Logstash seems to download it fine, that's when it starts reading events from its local copy of the file that it crashes with the above exception. ---
**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Post date:** [September 2, 2022, 12:46pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/4 "2022-09-02T12:46:30Z")
What is the size of the Java Heap for Logstash? Have you tried to increase it? Also, have you tried to download the file manually and use the `file` input plugin to read from it? I would suggest that you try that to see if the issue is with the input plugin or in the core of Logstash. I'm not sure how the `gloogle_cloud_storage` plugin works, if it reads the temporary file or if it loads it into memory. ---
**Author:** ![Alain\_Bod](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/alain_bod/32/77345_2.png) [@Alain\_Bod](https://discuss.elastic.co/u/Alain_Bod)\ **Post date:** [September 2, 2022, 2:53pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/5 "2022-09-02T14:53:09Z")
I've played around with the heap and stack size with no change in behavior (not even in the threshold of threads that it reaches before the crash). I did like you said: testing with a file input instead. Same behavior. So I run the same pipeline (with file input) in Logstash 7.17, and it works like a charm: the number of threads stays around 30. While running on 8.4, it keeps increasing until 18600+ and crashes. And then testing with 8.3.0: it works too... (number of threads stay around 30) That narrows down an issue in 8.4, isn't it? ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 2, 2022, 7:28pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/6 "2022-09-02T19:28:30Z")
@Alain_Bod @leandrojmp I just experienced something very similar with 8.4. 0 / 8.4.1 pipeline. I ran many times from 7.x to 8.3.3 is suddenly crashing in 8.4.0 / 8.4.1 complaining about resources. This is a single CSV File with about 2M records. Interesting mine is with CSV Filter as well... hmm I put a check in with engineering. @Alain_Bod I would probably revert back to your 7.17 or try 8.3.3 I see the exact same error message on my MAC ```auto [2022-09-01T11:52:51,964][FATAL][org.logstash.Logstash][org_dataset] uncaught error (in thread [org_dataset]>worker0) java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached ``` Then I ran 8.3.3. it loads about 2 million records. It's fine. This looks like a regression to me. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 5, 2022, 11:27pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/7 "2022-09-05T23:27:47Z")
@Alain_Bod Yup this is a regression Identified by Engineering, I don't have a github issue yet... so you will need to downgrade to 8.3.3 or less. BUT it did get me thinking I tested `dissect` filter it works.. and it is much faster for my 2M rows about twice as fast.... so you could convert to that if you desired. I have been told in general `dissect` is more efficient than `csv` ---
**Author:** ![seb.sch](https://avatars.discourse-cdn.com/v4/letter/s/94ad74/32.png) [@seb.sch](https://discuss.elastic.co/u/seb.sch)\ **Post date:** [September 8, 2022, 2:41pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/8 "2022-09-08T14:41:59Z")
I'm suffering from the same issue with the same config: Input is a CSV file, filter is the CSV one and output goes to Elasticsearch (and stdout {}). The error occurs since 8.4.X, the previous versions worked like a charm. However, the file is much smaller (only about 2000 lines) and it crashed with fewer threads: ```auto [20.486s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: 0k, detached. [20.486s][warning][os,thread] Failed to start the native thread for java.lang.Thread "Ruby-0-Fiber-991" {"level":"FATAL","loggerName":"org.logstash.Logstash","timeMillis":1662621252494,"thread":"[postalcode-csv]>worker0","logEvent":{"message":"uncaught error (in thread [postalcode-csv]>worker0)"}} ``` I've already reported it to the support team, but wanted to add to the discussion anyway. ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 8, 2022, 3:02pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/9 "2022-09-08T15:02:38Z")
@seb.sch @Alain_Bod @leandrojmp Here is the issue, it will be backported to 8.4 From engineering _"Unfortunately, this was an issue with the version of jruby and the csv gem it ships with, and will require an upgrade to logstash itself to fix, and not just a plugin upgrade"_ > > > Running the CSV filter on a large amount of data may eventually cause logstash \`…8.4.x\` to crash with the following error: > > \`\`\` > \[2022-09-01T11:52:51,964\]\[FATAL\]\[org.logstash.Logstash \]\[org\_dataset\] uncaught error (in thread \[org\_dataset\]\>worker0) > java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached > \`\`\` > > This appears to be due to a large amount of fibers/threads being created during CSV parsing: > > \`\`\` > "Fiber thread for block at: uri:classloader:/jruby/kernel/enumerator.rb:62" #920 daemon prio=5 os\_prio=31 cpu=0.43ms elapsed=7.45s tid=0x00007fa165b77e00 nid=0x7e703 waiting on condition \[0x0000700074c2a000\] > java.lang.Thread.State: WAITING (parking) > at jdk.internal.misc.Unsafe.park(java.base@17/Native Method) > - parking to wait for \<0x000000040219b708\> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(java.base@17/LockSupport.java:341) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(java.base@17/AbstractQueuedSynchronizer.java:506) > at java.util.concurrent.ForkJoinPool.unmanagedBlock(java.base@17/ForkJoinPool.java:3463) > at java.util.concurrent.ForkJoinPool.managedBlock(java.base@17/ForkJoinPool.java:3434) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@17/AbstractQueuedSynchronizer.java:1623) > at java.util.concurrent.ArrayBlockingQueue.take(java.base@17/ArrayBlockingQueue.java:420) > at org.jruby.ext.fiber.FiberQueue$1.run(org.jruby.dist/FiberQueue.java:55) > at org.jruby.ext.fiber.FiberQueue$1.run(org.jruby.dist/FiberQueue.java:52) > at org.jruby.RubyThread.executeTask(org.jruby.dist/RubyThread.java:1712) > at org.jruby.RubyThread.executeTaskBlocking(org.jruby.dist/RubyThread.java:1686) > at org.jruby.ext.fiber.FiberQueue.pop(org.jruby.dist/FiberQueue.java:91) > at org.jruby.ext.fiber.ThreadFiber.exchangeWithFiber(org.jruby.dist/ThreadFiber.java:109) > at org.jruby.ext.fiber.ThreadFiber.yield(org.jruby.dist/ThreadFiber.java:222) > at org.jruby.ext.fiber.ThreadFiber.yield(org.jruby.dist/ThreadFiber.java:229) > at org.jruby.ext.fiber.ThreadFiber$INVOKER$s$yield.call(org.jruby.dist/ThreadFiber$INVOKER$s$yield.gen) > at org.jruby.runtime.callsite.CachingCallSite.call(org.jruby.dist/CachingCallSite.java:75) > at uri\_3a\_classloader\_3a\_.jruby.kernel.enumerator.invokeOther0:yield(uri:classloader:/jruby/kernel/enumerator.rb:65) > at uri\_3a\_classloader\_3a\_.jruby.kernel.enumerator.RUBY$block$initialize$2(uri:classloader:/jruby/kernel/enumerator.rb:65) > at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17/DirectMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x0000000801290400.invoke(java.base@17/LambdaForm$MH) > at java.lang.invoke.DelegatingMethodHandle$Holder.delegate(java.base@17/DelegatingMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x0000000801177000.guard(java.base@17/LambdaForm$MH) > at java.lang.invoke.Invokers$Holder.linkToCallSite(java.base@17/Invokers$Holder) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$method$emit\_row$0(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:1122) > at java.lang.invoke.LambdaForm$DMH/0x00000008012b2c00.invokeStatic(java.base@17/LambdaForm$DMH) > at java.lang.invoke.LambdaForm$MH/0x0000000801149800.invokeExact\_MT(java.base@17/LambdaForm$MH) > at org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.dist/CompiledIRMethod.java:165) > at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.dist/MixedModeIRMethod.java:185) > at org.jruby.runtime.callsite.RefinedCachingCallSite.call(org.jruby.dist/RefinedCachingCallSite.java:95) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.invokeOther49:emit\_row(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:871) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$block$parse\_quotable\_loose$1(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:871) > at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17/DirectMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x0000000801290400.invoke(java.base@17/LambdaForm$MH) > at java.lang.invoke.DelegatingMethodHandle$Holder.delegate(java.base@17/DelegatingMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x0000000801177000.guard(java.base@17/LambdaForm$MH) > at java.lang.invoke.Invokers$Holder.linkToCallSite(java.base@17/Invokers$Holder) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$block$each\_line$1(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:52) > at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17/DirectMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x00000008012b2400.invoke(java.base@17/LambdaForm$MH) > at java.lang.invoke.LambdaForm$MH/0x0000000801161400.invokeExact\_MT(java.base@17/LambdaForm$MH) > at org.jruby.runtime.CompiledIRBlockBody.yieldDirect(org.jruby.dist/CompiledIRBlockBody.java:151) > at org.jruby.runtime.IRBlockBody.yieldSpecific(org.jruby.dist/IRBlockBody.java:89) > at org.jruby.runtime.Block.yieldSpecific(org.jruby.dist/Block.java:166) > at org.jruby.util.StringSupport.rbStrEnumerateLines(org.jruby.dist/StringSupport.java:2074) > at org.jruby.util.StringSupport.rbStrEnumerateLines(org.jruby.dist/StringSupport.java:1958) > at org.jruby.RubyString.each\_line(org.jruby.dist/RubyString.java:5944) > at org.jruby.RubyString$INVOKER$i$each\_line.call(org.jruby.dist/RubyString$INVOKER$i$each\_line.gen) > at org.jruby.runtime.callsite.RefinedCachingCallSite.call(org.jruby.dist/RefinedCachingCallSite.java:95) > at org.jruby.runtime.callsite.CachingCallSite.callIter(org.jruby.dist/CachingCallSite.java:192) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.invokeOther5:each\_line(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:49) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$method$each\_line$0(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:49) > at java.lang.invoke.LambdaForm$DMH/0x00000008012b2000.invokeStatic(java.base@17/LambdaForm$DMH) > at java.lang.invoke.LambdaForm$MH/0x0000000801149800.invokeExact\_MT(java.base@17/LambdaForm$MH) > at org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.dist/CompiledIRMethod.java:165) > at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.dist/MixedModeIRMethod.java:185) > at org.jruby.runtime.callsite.RefinedCachingCallSite.call(org.jruby.dist/RefinedCachingCallSite.java:95) > at org.jruby.runtime.callsite.CachingCallSite.callIter(org.jruby.dist/CachingCallSite.java:192) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.invokeOther54:each\_line(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:823) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$method$parse\_quotable\_loose$0(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:823) > at java.lang.invoke.LambdaForm$DMH/0x00000008012b1c00.invokeStatic(java.base@17/LambdaForm$DMH) > at java.lang.invoke.Invokers$Holder.invokeExact\_MT(java.base@17/Invokers$Holder) > at org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.dist/CompiledIRMethod.java:152) > at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.dist/MixedModeIRMethod.java:148) > at org.jruby.runtime.callsite.RefinedCachingCallSite.call(org.jruby.dist/RefinedCachingCallSite.java:71) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.invokeOther26:parse\_quotable\_loose(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:336) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$method$parse$0(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:336) > at Users.robbavey.$\_dot\_rvm.rubies.jruby\_minus\_9\_dot\_3\_dot\_6\_dot\_0.lib.ruby.stdlib.csv.parser.RUBY$method$parse$0$\_\_VARARGS\_\_(/Users/robbavey/.rvm/rubies/jruby-9.3.6.0/lib/ruby/stdlib/csv/parser.rb:318) > at java.lang.invoke.LambdaForm$DMH/0x00000008012a7800.invokeStatic(java.base@17/LambdaForm$DMH) > at java.lang.invoke.LambdaForm$MH/0x0000000801149800.invokeExact\_MT(java.base@17/LambdaForm$MH) > at org.jruby.internal.runtime.methods.CompiledIRMethod.call(org.jruby.dist/CompiledIRMethod.java:139) > at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(org.jruby.dist/MixedModeIRMethod.java:112) > at org.jruby.RubyClass.finvokeWithRefinements(org.jruby.dist/RubyClass.java:512) > at org.jruby.RubyBasicObject.send(org.jruby.dist/RubyBasicObject.java:1733) > at org.jruby.RubyBasicObject$INVOKER$i$send.call(org.jruby.dist/RubyBasicObject$INVOKER$i$send.gen) > at org.jruby.runtime.callsite.CachingCallSite.call(org.jruby.dist/CachingCallSite.java:85) > at org.jruby.runtime.callsite.CachingCallSite.callIter(org.jruby.dist/CachingCallSite.java:94) > at uri\_3a\_classloader\_3a\_.jruby.kernel.enumerator.invokeOther3:\_\_send\_\_(uri:classloader:/jruby/kernel/enumerator.rb:64) > at uri\_3a\_classloader\_3a\_.jruby.kernel.enumerator.RUBY$block$initialize$1(uri:classloader:/jruby/kernel/enumerator.rb:64) > at java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(java.base@17/DirectMethodHandle$Holder) > at java.lang.invoke.LambdaForm$MH/0x00000008012afc00.invoke(java.base@17/LambdaForm$MH) > at java.lang.invoke.LambdaForm$MH/0x0000000801161400.invokeExact\_MT(java.base@17/LambdaForm$MH) > at org.jruby.runtime.CompiledIRBlockBody.yieldDirect(org.jruby.dist/CompiledIRBlockBody.java:151) > at org.jruby.runtime.IRBlockBody.yieldSpecific(org.jruby.dist/IRBlockBody.java:72) > at org.jruby.runtime.Block.yieldSpecific(org.jruby.dist/Block.java:157) > at org.jruby.ext.fiber.ThreadFiber.lambda$createThread$0(org.jruby.dist/ThreadFiber.java:302) > at org.jruby.ext.fiber.ThreadFiber$$Lambda$971/0x00000008012632c8.run(org.jruby.dist/Unknown Source) > at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@17/ThreadPoolExecutor.java:1136) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@17/ThreadPoolExecutor.java:635) > at java.lang.Thread.run(java.base@17/Thread.java:833) > \`\`\` I will re-add... `dissect` rocks 🙂 ---
**Author:** ![Alain\_Bod](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/alain_bod/32/77345_2.png) [@Alain\_Bod](https://discuss.elastic.co/u/Alain_Bod)\ **Post date:** [September 8, 2022, 3:24pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/10 "2022-09-08T15:24:46Z")
`dissect` rocks when you are sure of your input format, right? When in CSV, the quote character may or may not present depending on the field, how do you handle it with dissect? ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 8, 2022, 3:29pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/11 "2022-09-08T15:29:59Z")
Yeah `dissect` requires a little more "understanding" of data. You would need to know where the quotes are ahead of time and add them to the dissect patterns, so it does not fit every use case. Something like (note the single quotes) ```auto filter { dissect { mapping => { "message" => '%{name},"%{addr1}",%{addr2},%{addr3},%{city},%{zip}' } } } ``` ---
**Author:** ![Henri\_L](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/henri_l/32/102762_2.png) [@Henri\_L](https://discuss.elastic.co/u/Henri_L)\ **Post date:** [September 17, 2022, 10:30am UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/12 "2022-09-17T10:30:23Z")
Hi do you have a process to make it work on debian 10 with 8.4 version? Or should I downgrade in waiting (but waiting what;) ) Thanks ---
**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\ **Post date:** [September 17, 2022, 2:52pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/13 "2022-09-17T14:52:25Z")
Hi @Henri_L No easy workaround other than Use dissect. Looks like fix is merged and marked for 8.4.2 which should be soon. ---
**Author:** ![Henri\_L](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/henri_l/32/102762_2.png) [@Henri\_L](https://discuss.elastic.co/u/Henri_L)\ **Post date:** [September 19, 2022, 1:06pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/14 "2022-09-19T13:06:06Z")
thanks I will wait for 8.4.2 and in the meantime I'll downgrade to 8.3.3 😉 ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [October 17, 2022, 1:06pm UTC](https://discuss.elastic.co/t/logstash-number-of-threads-keeps-increasing-until-crash/313463/15 "2022-10-17T13:06:20Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.