Gelf output to Logstash not working

[pointonj (joseph)]

Hi,

I'm trying to get the logs from my Graylog server into 3 Logstash Servers that are load balanced. I'm not sure if this is an issue with Graylog or Logstash but as i've posted this on the Graylog community and got no response i thought i would put it here and see what response i get.

The Issue is my Graylog server cant connect to the Loadbalancer and i'm no sure which side the miss-configuration is.

My loadbalancer is set to send everything it receives on port 5606 to the logstash servers on port 5606

This is the error i get on my Graylog server
ERROR [GelfTcpTransport] Connection failed: connection timed out: /LoadBalancerIP:5606

This is my Logstash config -

input {
  gelf {
    use_tcp => true
    port => 5606
  }
}

output {
     kafka {
        bootstrap_servers => "kafkaIP:9092"
        topic_id => "AIALOGS"
     }
}

Logstash start up correctly as i get the start up logs you need.

[INFO ] 2020-07-21 15:34:53.977 [[main]-pipeline-manager] javapipeline - Pipeline started {"pipeline.i                                  d"=>"main"}
[INFO ] 2020-07-21 15:34:54.054 [Ruby-0-Thread-8: :1] gelf - Starting gelf listener (tcp) ... {:addres                                  s=>"0.0.0.0:5606"}
[INFO ] 2020-07-21 15:34:54.060 [Ruby-0-Thread-9: :1] gelf - Starting gelf listener (udp) ... {:addres                                  s=>"0.0.0.0:5606"}
[INFO ] 2020-07-21 15:34:54.095 [Agent thread] agent - Pipelines running {:count=>1, :running_pipeline                                  s=>[:main], :non_running_pipelines=>[]}
[INFO ] 2020-07-21 15:34:54.497 [Api Webserver] agent - Successfully started Logstash API endpoint {:p                                  ort=>9600}

This is what leads me to believe its an issue with Graylog but i thought i would ask here to see if anyone could help?