Filebeat not collecting all logs

Elastic Stack Beats
1

I have issue with filebeat. I'm using autodiscover for kubernetes. Filebeat is collecting logs and sending them to elastic and they are visible in kibana. Some logs are not sending and I don't understand why. I see in Kibana log:

Starting Application using Java 17.0.5 on....

but I don't see in kibana

Error starting ApplicationContext. To display the conditions report re-run your application with ....

My filebeat.yaml


filebeat.yml: |-
filebeat.shutdown_timeout: 300s

filebeat.autodiscover:
  providers:
    - type: kubernetes
      templates:
        - condition:
            equals:
              kubernetes.namespace: {{ .Release.Namespace }}
          config:
            - type: container
              paths:
                - "/var/log/containers/*-${data.kubernetes.container.id}.log"
              fields:
                installation: ${INSTALLATION_NAME}
              containers.ids:
                - "${data.kubernetes.container.id}"
              multiline.pattern: '^\{'
              multiline.negate: true
              multiline.match: after
              multiline.timeout: 120s #default 5s
              multiline.max_lines: 10000 #default 500
              processors:
                - decode_json_fields:
                    fields: message
                    max_depth: 9
                    target: ""
                    overwrite_keys: true
                    add_error_key: true
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.