Hi All,
I am wondering, shall we use a logstash config file without the input section? Apparently, it works without complain.
I tried that using settings like below:
input {
stdin{}
}
filter {
ruby {
# here i call python script to process data
}
}
output {
stdout{}
}
Came up with this idea to try to process data in bulk/parallel, but still prefer logstash to 'inform' that new data is available.
Hopefully someone could share the knowledge with me on how does logstash gets 'informed that new data is available and it is time to work on the new data'.
Best.