Hi All,
logstash javapipeline is terminating
Please can anyone help on this issue, It will be much helpful for us.
logstash-plain
[2022-02-01T08:06:01,333][INFO ][logstash.runner ] Log4j configuration path used is: D:\InstalledTools\logstash-7.16.2\config\log4j2.properties
[2022-02-01T08:06:01,364][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.16.2", "jruby.version"=>"jruby 9.2.20.1 (2.5.8) 2021-11-30 2a2962fbd1 OpenJDK 64-Bit Server VM 11.0.13+8 on 11.0.13+8 +indy +jit [mswin32-x86_64]"}
[2022-02-01T08:06:01,489][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2022-02-01T08:06:04,399][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600, :ssl_enabled=>false}
[2022-02-01T08:06:05,837][INFO ][org.reflections.Reflections] Reflections took 172 ms to scan 1 urls, producing 119 keys and 417 values
[2022-02-01T08:06:07,915][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>6, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>750, "pipeline.sources"=>["D:/InstalledTools/logstash-7.16.2/config/harvester-pipeline.conf"], :thread=>"#<Thread:0x7d2b26cb run>"}
[2022-02-01T08:06:09,712][INFO ][logstash.javapipeline ][main] Pipeline Java execution initialization time {"seconds"=>1.8}
[2022-02-01T08:06:09,743][INFO ][logstash.inputs.beats ][main] Starting input listener {:address=>"0.0.0.0:5044"}
[2022-02-01T08:06:09,758][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"}
[2022-02-01T08:06:09,930][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2022-02-01T08:06:10,040][INFO ][org.logstash.beats.Server][main][a9817c5808b2cb6bd031f8306450ca544d2d615723db61acc6421fac427efb7b] Starting server on port: 5044
[2022-02-01T08:06:28,200][INFO ][logstash.outputs.file ][main][8c4282e9a65a8c6f0d988eccc1a64b514076a67aac8c478cecf85de32fb692f8] Opening file {:path=>"D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log"}
[2022-02-01T08:07:19,804][INFO ][logstash.outputs.file ][main][8c4282e9a65a8c6f0d988eccc1a64b514076a67aac8c478cecf85de32fb692f8] Closing file D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log
[2022-02-01T08:07:57,661][INFO ][logstash.outputs.file ][main][8c4282e9a65a8c6f0d988eccc1a64b514076a67aac8c478cecf85de32fb692f8] Opening file {:path=>"D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log"}
[2022-02-01T08:24:18,491][INFO ][logstash.outputs.file ][main][8c4282e9a65a8c6f0d988eccc1a64b514076a67aac8c478cecf85de32fb692f8] Opening file {:path=>"D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log"}
[2022-02-01T08:24:18,491][INFO ][logstash.outputs.file ][main][8c4282e9a65a8c6f0d988eccc1a64b514076a67aac8c478cecf85de32fb692f8] Opening file {:path=>"D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log"}
For a period of time logstash is running fine, but approximately after 15 to 20 min it is terminating, we gave all the permissions for it , but still we are facing this issue.
Error Details:
[2022-02-01T08:24:18,506][ERROR][logstash.javapipeline ][main] Pipeline worker error, the pipeline will be stopped {:pipeline_id=>"main", :error=>"(EACCES) Permission denied - D:/MARS/WatchFolder/MARS_FILENET_CPE_QUEUE/DEV-FIC-Harvester.log", :exception=>Java::OrgJrubyExceptions::SystemCallError, :backtrace=>["org.jruby.RubyIO.sysopen(org/jruby/RubyIO.java:1237)", "org.jruby.RubyFile.initialize(org/jruby/RubyFile.java:365)", "org.jruby.RubyIO.new(org/jruby/RubyIO.java:876)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_file_minus_4_dot_3_dot_0.lib.logstash.outputs.file.open(D:/InstalledTools/logstash-7.16.2/vendor/bundle/jruby/2.5.0/gems/logstash-output-file-4.3.0/lib/logstash/outputs/file.rb:276)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_file_minus_4_dot_3_dot_0.lib.logstash.outputs.file.multi_receive_encoded(D:/InstalledTools/logstash-7.16.2/vendor/bundle/jruby/2.5.0/gems/logstash-output-file-4.3.0/lib/logstash/outputs/file.rb:119)", "org.jruby.RubyHash.each(org/jruby/RubyHash.java:1415)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_file_minus_4_dot_3_dot_0.lib.logstash.outputs.file.multi_receive_encoded(D:/InstalledTools/logstash-7.16.2/vendor/bundle/jruby/2.5.0/gems/logstash-output-file-4.3.0/lib/logstash/outputs/file.rb:118)", "org.jruby.ext.thread.Mutex.synchronize(org/jruby/ext/thread/Mutex.java:164)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_file_minus_4_dot_3_dot_0.lib.logstash.outputs.file.multi_receive_encoded(D:/InstalledTools/logstash-7.16.2/vendor/bundle/jruby/2.5.0/gems/logstash-output-file-4.3.0/lib/logstash/outputs/file.rb:117)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.logstash_minus_core.lib.logstash.outputs.base.multi_receive(D:/InstalledTools/logstash-7.16.2/logstash-core/lib/logstash/outputs/base.rb:103)", "org.logstash.config.ir.compiler.OutputStrategyExt$AbstractOutputStrategyExt.multi_receive(org/logstash/config/ir/compiler/OutputStrategyExt.java:143)", "org.logstash.config.ir.compiler.AbstractOutputDelegatorExt.multi_receive(org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:121)", "D_3a_.InstalledTools.logstash_minus_7_dot_16_dot_2.logstash_minus_core.lib.logstash.java_pipeline.start_workers(D:/InstalledTools/logstash-7.16.2/logstash-core/lib/logstash/java_pipeline.rb:299)"], :thread=>"#<Thread:0x7d2b26cb sleep>"}
[2022-02-01T08:24:20,866][WARN ][logstash.javapipeline ][main] Waiting for input plugin to close {:pipeline_id=>"main", :thread=>"#<Thread:0x7d2b26cb run>"}
[2022-02-01T08:24:23,990][INFO ][logstash.javapipeline ][main] Pipeline terminated {"pipeline.id"=>"main"}
I really appreciate your help upon resolving this issue,
Thanks.