Filebeat not able to send all logs

Elastic Stack Beats
1

Hello all,
I am using filebeat 7.9.3. Recently we did load testing on our server almost 4 hours. During load testing almost 1 and GB files created every hour. File rotation policy is after every 1 hour.

Before load testing for every 1 hour log file size is almost 300 to 400 MB.

I am sending logs to logstash -> Elasticsearch->Kibana. But we didn't get all logs generated during load test in kibana.

PFB filebeat.yml

filebeat.inputs:

- type: log
  enabled: true
  paths:
	- /apps/applog/01/logs/jd.log
	- /apps/applog/02/logs/jd.log
	- /apps/applog/03/logs/jd.log
	- /apps/applog/04/logs/jd.log

  multiline.pattern: '^[0-9]{4}-[0-9]{2}-[0-9]{2}'
  multiline.negate: true
  multiline.match: after
  fields_under_root: true
  fields:
labels.kind: cs
labels.app_source: r3-cs
labels.environment: uat

close_renamed: true

output.logstash:
  hosts: ["localhost:5044"]
  ssl.certificate_authorities: "/etc/filebeat/local.pem"
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.