Recently i started working on log forwarding to Kibana / ES and Apache NiFi thru logstash-forwarder and i am successfully finished the same. But, i came to know logstash-forwarder is deprecated and Filebeat is replacement of logstash-forwarder.
I configured logstash-forwarder with 50011 port which is enabled on ListenLumberjack processor inside NiFi. It reads all the logs and then it keeps them into ES and as well as into any DB. But, I am unable to forward the logs to any TCP (50011) ports from Filebeat. If so, i can stop using logstash-forwarder. Can someone please let me know is there any way to send the logs to Apache NiFi lumberjack with Filebeat ?
My current Flow :
Logstash-forwarder -> reads log files from system/apache -> sends -> NiFi ListenLumberjack (50011) -> Reads the logs -> Transforms the logs to -> Elasticseach & NiFi PutSQL processor.
Expecting Flow :
Filebeat -> reads log files from system/apache -> sends to -> NiFi ListenLumberjack (50011) -> Reads the logs -> Transforms the logs to -> Elasticseach & NiFi PutSQL processor.
Thanks in advance,