Missing metrics in Logstash node stats

ofekinger · December 6, 2023, 10:32am

Hello everyone,
I went over the code for a few Logstash plugins and noticed they had metrics that I can't see when running:
curl http://localhost:9600/_node/stats

I'm talking about metrics like:

github.com

logstash-plugins/logstash-input-beats/blob/a6cdac9f80e21023ba6ea42c0cd55e6c0ab34a8d/lib/logstash/inputs/beats/message_listener.rb#L201


      
            def from_filebeat?(hash)
              !hash[FILEBEAT_LOG_LINE_FIELD].nil?
            end
          
            def from_logstash_forwarder?(hash)
              !hash[LSF_LOG_LINE_FIELD].nil?
            end
          
            def increment_connection_count
              current_connection_count = @connections_list.size
              @metric.gauge(:current_connections, current_connection_count)
              if current_connection_count > @peak_connection_count.value
                @peak_connection_count.value = current_connection_count
                @metric.gauge(:peak_connections, @peak_connection_count.value)
              end
            end
          
            def decrement_connection_count
              @metric.gauge(:current_connections, @connections_list.size)
            end
          end

And a few other places I found in other plugins (some are in filter plugins like dissect).

Am I missing something? Or do these metrics just not show up in the stats API?
Thanks in advance!

Rios · December 6, 2023, 11:24am

I don't think they are visible. You have here LS metric fields.

ofekinger · December 6, 2023, 12:10pm

I'm using the stats API and not Metricbeat.
The weird thing is that I do see other metrics (such as "workers" and "queue_size" for the udp input plugin).
I'm not sure why some of the metrics are visible in the node stats API and some aren't.

ofekinger · December 6, 2023, 2:20pm

Never mind, I only checked the code and the basic configuration without connecting a beat to the running Logstash. Only then the metrics showed up.

system · January 3, 2024, 2:20pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.