Missing metrics in Logstash node stats

ofekinger · December 6, 2023, 10:32am

Hello everyone,
I went over the code for a few Logstash plugins and noticed they had metrics that I can't see when running:
curl http://localhost:9600/_node/stats

I'm talking about metrics like:

github.com

logstash-plugins/logstash-input-beats/blob/a6cdac9f80e21023ba6ea42c0cd55e6c0ab34a8d/lib/logstash/inputs/beats/message_listener.rb#L201


      
            def from_filebeat?(hash)
              !hash[FILEBEAT_LOG_LINE_FIELD].nil?
            end
          
            def from_logstash_forwarder?(hash)
              !hash[LSF_LOG_LINE_FIELD].nil?
            end
          
            def increment_connection_count
              current_connection_count = @connections_list.size
              @metric.gauge(:current_connections, current_connection_count)
              if current_connection_count > @peak_connection_count.value
                @peak_connection_count.value = current_connection_count
                @metric.gauge(:peak_connections, @peak_connection_count.value)
              end
            end
          
            def decrement_connection_count
              @metric.gauge(:current_connections, @connections_list.size)
            end
          end

And a few other places I found in other plugins (some are in filter plugins like dissect).

Am I missing something? Or do these metrics just not show up in the stats API?
Thanks in advance!

Rios · December 6, 2023, 11:24am

I don't think they are visible. You have here LS metric fields.

ofekinger · December 6, 2023, 12:10pm

I'm using the stats API and not Metricbeat.
The weird thing is that I do see other metrics (such as "workers" and "queue_size" for the udp input plugin).
I'm not sure why some of the metrics are visible in the node stats API and some aren't.

ofekinger · December 6, 2023, 2:20pm

Never mind, I only checked the code and the basic configuration without connecting a beat to the running Logstash. Only then the metrics showed up.

system · January 3, 2024, 2:20pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Logstash Metrics unavailable on Kibana Stack Monitoring UI Logstash elastic-stack-monitoring	9	420	November 2, 2023
No metricdata in Kibana Kibana	6	432	August 23, 2019
Logstash Pipeline with elasticsearch output missing in Stack Monitoring Kibana	2	328	December 13, 2022
Metricbeat counter logstash API Beats metricbeat	4	1118	January 11, 2017
Monitoring Logstash with Metricbeat Logstash elastic-stack-monitoring	4	327	May 28, 2020

Missing metrics in Logstash node stats

Related topics