Lumberjack input/output plugin AWS LoadBalancer

Elastic Stack Logstash
1

Hi,

I have running two logstash server on different kubernetes cluster with the lumberjack input/output plugin.

My config.

Client:

output {
lumberjack {
hosts => [ "XXXXXXXXXXXXXXXXXXXXXXXXXXXX-CCCCCCCCC.us-east-1.elb.amazonaws.com" ]
port => 6782
ssl_certificate => '/etc/logstash/certs/server.crt'
}
}

Server:

input {
lumberjack {
port => 6782
ssl_certificate => '/etc/logstash/certs/server.crt'
ssl_key => '/etc/logstash/certs/server.key'
}
}

Client log:

10:05:23.081 [[main]-pipeline-manager] ERROR logstash.outputs.lumberjack - All hosts unavailable, sleeping {:hosts=>[], :e=>#<RuntimeError: Could not connect to any hosts>, :backtrace=>["/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jls-lumberjack-0.0.26/lib/lumberjack/client.rb:31:in connect'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jls-lumberjack-0.0.26/lib/lumberjack/client.rb:24:ininitialize'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-lumberjack-3.1.5/lib/logstash/outputs/lumberjack.rb:86:in connect'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-lumberjack-3.1.5/lib/logstash/outputs/lumberjack.rb:49:inregister'", "org/jruby/RubyArray.java:1613:in each'", "/usr/share/logstash/logstash-core/lib/logstash/output_delegator_strategies/legacy.rb:17:inregister'", "/usr/share/logstash/logstash-core/lib/logstash/output_delegator.rb:41:in register'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:281:inregister_plugin'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:292:in register_plugins'", "org/jruby/RubyArray.java:1613:ineach'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:292:in register_plugins'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:301:instart_workers'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:226:in run'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:398:instart_pipeline'"]}

Can you tell me what I'm doing wrong?

Thanks in advance.

Regards, jerry

2

This error message suggests a network problem. Have you verified that you can connect to the host and port via e.g. telnet?

3

Hi Magnus,

Yes, I have verified with telnet. I can connect to the LoadBalancer via telnet.

telnet XXXXXXXXXXXXXXXXXXXXXXXXXXXX-CCCCCCCCC.us-east-1.elb.amazonaws.com 6782
Trying XXX.XXX.XXX.XXX...
Connected to XXXXXXXXXXXXXXXXXXXXXXXXXXXX-CCCCCCCCC.us-east-1.elb.amazonaws.com.
Escape character is '^]'.
^CConnection closed by foreign host.

If I use for test the public IP from the LoadBalancer then it works.

Regards, jerry

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.