Logstash internal monitoring not sending any info

[Vincent_Maury]

Hi,
I've setup Elasticsearch, Kibana and Logstash using https://www.elastic.co/guide/en/elastic-stack/current/installing-elastic-stack.html
I activated monitoring from Kibana monitoring UI.
then I tried configuring the logstash internal collection of monitoring data (https://www.elastic.co/guide/en/logstash/current/monitoring-internal-collection.html) by adding the xpack.monitoring.collection.enabled: true in elasticsearch.yml config, then the xpack.monitoring.enabled: trueand xpack.monitoring.elasticsearch.hosts: ["http://localhost:9200"] in logstash.yml
But there is no logstash monitoring index created in Elasticsearch, and no data displayed in Kibana monitoring...
Any clue please?
Thanks a lot in advance!

[rugenl (Len Rugen)]

Did you secure elasticsearch? If so, you will need to add security to the logstash elasticsearch output.

[Vincent_Maury]

No, in the simple installation guide there is no security
So I didn't set any
It's supposed to work as well without authentication right?

[chrisronline (Chris Roberson)]

Do you have any defined pipelines? The stack monitoring UI will not show any logstash monitoring data if it does not detect any pipelines.

[Vincent_Maury]

Hi Chris,
I do have a "main" pipeline, but I'm running logstash with a -f file.conf
not using multiple pipelines, not using central management either

[rugenl (Len Rugen)]

Ok, you can do this to see if get stats:

curl -XGET 'localhost:9600/_node/stats/events?pretty'

Any errors in logstash or elastic logs? Is logstash processing events that are getting to elasticsearch?

[chrisronline (Chris Roberson)]

Try running this query against the monitoring cluster and return the results:

POST .monitoring-logstash-*/_search
{
  "size": 1,
  "sort": [
    {
      "timestamp": {
        "order": "desc"
      }
    }
  ],
  "query": {
    "term": {
      "type": {
        "value": "logstash_stats"
      }
    }
  },
  "collapse": {
    "field": "cluster_uuid"
  }
}