I am pulling data from multiple s3 buckets using s3 input plugin. While I am running job manually from terminal, it executed successfully, but when i schedule it to run from crontab it's throwing following error:
[2020-01-28T02:01:06,410][FATAL][logstash.runner ] An unexpected error occurred! {:error=>#<Errno::EPIPE: Broken pipe - >, :backtrace=>["org/jruby/RubyIO.java:1472:in write'", "org/jruby/RubyIO.java:1429:in
write'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-stdout-3.1.4/lib/logstash/outputs/stdout.rb:43:in block in multi_receive_encoded'", "org/jruby/RubyArray.java:1792:in
each'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-stdout-3.1.4/lib/logstash/outputs/stdout.rb:42:in multi_receive_encoded'", "/usr/share/logstash/logstash-core/lib/logstash/outputs/base.rb:87:in
multi_receive'", "org/logstash/config/ir/compiler/OutputStrategyExt.java:118:in multi_receive'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:101:in
multi_receive'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:390:in block in output_batch'", "org/jruby/RubyHash.java:1419:in
each'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:389:in output_batch'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:341:in
worker_loop'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:304:in `block in start_workers'"]}
[2020-01-28T02:01:06,510][ERROR][org.logstash.Logstash ] java.lang.IllegalStateException: Logstash stopped processing because of an error: (EPIPE) Broken pipe -
Rajnish