Filebeat, missing rows in elastic index

Elastic Stack Beats
1

Hi I have filebeat (7.4) with config as follows

filebeat:
  config:
    modules:
      path: /etc/filebeat/modules.d/*.yml
      reload:
        enabled: false
  inputs:
  - enabled: true
    paths:
    - /var/www/ewyszukiwarka/cli/var/log/dev-*.log
    type: log
output:
  logstash:
    hosts:
    - audit.logstash:5044
path:
  config: /etc/filebeat
  data: /var/lib/filebeat
  home: /usr/share/filebeat
  logs: /var/log/filebeat
processors:
- add_host_metadata: null
- add_cloud_metadata: null
setup:
  kibana: null
  template:
    settings:
      index:
        number_of_shards: 1

And from time to time, filebeat is not reading whole file, some rows are missing in my elasticsearch, for example I have file in which I have 887 lines, and I elasticsearch index there is only 878 documents. All log lines are the same, so its not mapping problem

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.