We have a requirement where we need to parse two different logs using filebeat.
- Send the first file content to Kafka
- Since the second file has lot of irrelevant information, some basic filtering will be done in filebeat and the rest of the content should be written to another file in the same machine.
I've seen that filebeat was supporting multiple output in 5.6.0, but in 6.x version I see that feature is removed stating that there would be problem with the registry.
Can some one explain why this is not supported in 6.x though we are going to harvest different file and send to different output. And any possible solution without sending the data to logstash since we need the filtered content of second file to be available in that same machine.