I am new to whole Logstash/ELK. But I am wondering if I can use filebeat for streaming binary data to network ?
Here is what I am trying to do.
Multiple processes (in hundreds) have lib in them to encode data and write to corresponding "logs files"(binary encoded files to save space) of the processes. If we want to read them "log files" in human readable format we can to by running it them a decoder I have.
Now what I want to do is stream the "log files" to a remote location via filebeat and run my decoder there. So is this possible via logstash or filebeat ?
This is my firstpost and any help is much appreciated. Thanks.
P.S. I can run my decoder where the "log files" are being generated and feed the output location to filebeat but It kills both my cpu and network. So i want to stream the encoded files incrementally and use my decoder on the cloud.