Filebeat stops harvesting files

Elastic Stack Beats
1

Filebeat vesion: 7.10

Filebeat sometimes throws the following errors and stops harvesting a file:

Harvester could not be started on existing file: /var/lib/docker/containers/acaeae7d8182fc7c78a5066a178593640ce4fbc920b4f722e1c995ddcade8e61/acaeae7d8182fc7c78a5066a178593640ce4fbc920b4f722e1c995ddcade8e61-json.log, Err: registry already stopped
File cleanup state update error: input outlet closed

I'm using the filebeat autodiscover, example config:

filebeat.autodiscover:
  providers:
  - hints.enabled: false
    templates:
    - condition:
[...]
      config:
      - clean_removed: true
        fields:
[...]
        fields_under_root: true
        ignore_older: 10m
        paths:
        - /var/lib/docker/containers/${data.kubernetes.container.id}/*-json.log
        - /var/lib/docker/containers/${data.kubernetes.container.id}/*-json.log.*
        scan_frequency: 5s
        type: container

A pod restart resolves the issue. Any ideas? Should I open a Github issue?

Regards
Bernd

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.