I used filebeat to connect to Kafka.
Everytime I add some new lines to the log file, I want filebeat only output this contents to Kafka.
My Input of filebeat.yml as below:
filebeat.inputs:
- type: log
enabled: true
paths:- /Users/ll/Documents/test06.log
tail_files: true
- /Users/ll/Documents/test06.log
And I Start filebeat using below command:
brew services start elastic/tap/filebeat-full
cd /usr/local/etc/filebeat/
filebeat -e -c filebeat.yml -d "publish"