Filebeat is running but not sending logs to logstash

[ats]

Hi folks,
I configured filebeat on a ubuntu instance in aws and sending logs to Logstash but it's not sending to Logstash.

Here is my filebeat yml file

# ---------------------------- Elasticsearch Output ----------------------------
#output.elasticsearch:
  # Array of hosts to connect to.
  # hosts: ["172.31.70.167:9200"]

  # Protocol - either `http` (default) or `https`.
  #protocol: "https"

  # Authentication credentials - either API key or username/password.
  #api_key: "id:api_key"
  # username: "elastic"
  # password: "uCadaqwWfb0EeZNRtivO"

# ------------------------------ Logstash Output -------------------------------
output.logstash:
  # The Logstash hosts
  hosts: "172.31.70.167:5044"

  #protocol: "https"

  username: "logstash_system"
  password: "EWM4ycvSJvcth2MpfvVE"


  # Optional SSL. By default is off.
  # List of root certificates for HTTPS server verifications
  #ssl.certificate_authorities: ["/etc/pki/root/ca.pem"]

  # Certificate for SSL client authentication
  #ssl.certificate: "/etc/pki/client/cert.pem"

  # Client Certificate Key
  #ssl.key: "/etc/pki/client/cert.key"
setup.ilm.enabled: false

Here's my Logstash input

    input {
      elasticsearch {
        port => 5044
        user => "logstash_system"
        password => "EWM4ycvSJvcth2MpfvVE"

      }
    }

Seeing this error

2021-01-26T15:36:17.641Z INFO instance/beat.go:299 Setup Beat: filebeat; Version: 7.10.1

2021-01-26T15:36:17.642Z INFO [publisher] pipeline/module.go:113 Beat name: ip-172-31-70-167

2021-01-26T15:36:17.643Z WARN beater/filebeat.go:178 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.

2021-01-26T15:36:17.647Z ERROR instance/beat.go:956 Exiting: Index management requested but the Elasticsearch output is not configured/enabled

Exiting: Index management requested but the Elasticsearch output is not configured/enabled

[stephenb (Stephen Brown)]

Hi @ats

You are using the wrong input type in your logstash config...

It should look something like this also why not leave ILM on...

################################################
# beats->logstash->es default config.
################################################
input {
  beats {
    port => 5044
  }
}

output {
  if [@metadata][pipeline] {
    elasticsearch {
      hosts => "http://localhost:9200"
      manage_template => false
      index => "%{[@metadata][beat]}-%{[@metadata][version]}"
      pipeline => "%{[@metadata][pipeline]}" 
      user => "elastic"
      password => "secret"
    }
  } else {
    elasticsearch {
      hosts => "http://localhost:9200"
      manage_template => false
      index => "%{[@metadata][beat]}-%{[@metadata][version]}"
      user => "elastic"
      password => "secret"
    }
  }
}