Hello. I've issue with harvest logs from my cluster k8s with filebeat.
In my config file I use next path:
symlinks: true
path:
- /var/log/containers/*-${data.kubernetes.container.id}.log
But some my apps write a lot of logs.
Since this file is symlinks to
/vat/logs/pods/*some_pods_name*/*container_name*/0.log
filebeat sometimes doesn't have time to collect all lines when 0.log was rotate.
I've tried to change path to 0.log files but since then I don't see any logs in kibana at all. But in logs in filebeat I see that it is find my logs files and starting work with them.
Could you please suggest me some solution with my problem?