log:
Jan 11 10:26:45 fnw-test-logstash-3 systemd[1]: logstash.service: main process exited, code=exited, status=143/n/a
Jan 11 10:26:45 fnw-test-logstash-3 systemd[1]: Stopped logstash.
Jan 11 10:26:45 fnw-test-logstash-3 systemd[1]: Unit logstash.service entered failed state.
Jan 11 10:26:45 fnw-test-logstash-3 systemd[1]: logstash.service failed.
Jan 11 10:26:45 fnw-test-logstash-3 systemd[1]: Started logstash.
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59:in `require':
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: It seems your ruby installation is missing psych (for YAML output).
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: To eliminate this warning, please install libyaml and reinstall your ruby.
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: [ERROR] 2019-01-11 10:26:51.700 [main] Logstash - java.lang.IllegalStateException: Logstash stopped processing because of an error: (GemspecError) There was a LoadError while loading logstash-core.gemspec:
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: load error: psych -- java.lang.RuntimeException: BUG: we can not copy embedded jar to temp directory from
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: /usr/share/logstash/logstash-core/logstash-core.gemspec:1:in `block in (root)'
Jan 11 10:26:51 fnw-test-logstash-3 logstash[18854]: Does it try to require a relative path? That's been removed in Ruby 1.9.
Jan 11 10:26:51 fnw-test-logstash-3 systemd[1]: logstash.service: main process exited, code=exited, status=1/FAILURE
Jan 11 10:26:51 fnw-test-logstash-3 systemd[1]: Unit logstash.service entered failed state.
Jan 11 10:26:51 fnw-test-logstash-3 systemd[1]: logstash.service failed.
Jan 11 10:26:52 fnw-test-logstash-3 systemd[1]: logstash.service holdoff time over, scheduling restart.
Jan 11 10:26:52 fnw-test-logstash-3 systemd[1]: Stopped logstash.
logstash-kafka.conf:
input {
kafka {
bootstrap_servers => "10.39.40.25:9092,10.39.40.29i:9092,10.39.40.30:9092"
topics => ["fnw_logging_kafka_topic"]
group_id => "fnw-logstash-test"
auto_offset_reset => "latest"
consumer_threads => 3
decorate_events => true
type => "fnw-logstash-kafka"
codec => json
}
}
output {
elasticsearch {
hosts => [ "10.39.40.2:9200,10.39.40.5:9200,10.39.40.6:9200" ]
action => "index"
index => fnw_test_"%{type}-%{+YYYYMMdd}"
}
}
logstash.yml:
node.name: fnw-test-logstash-3
path.data: /data/logstash
path.logs: /data/logstash-log
other config default...