I am building a filter plugin that calls a ruby .rb code file. The filter itself is well documented.
The issues I have is with ruby gems and the transmission of variables:
The documentation says that ruby gems don't work. I however need to include "nokogiri" in the .rb file for crawling a website. When will this feature be possible? - see below.
I also need to transfer variables from logstash to .rb ("script_params" I assume). And then from .rb back to the logstash pipeline - how does this work?
Even though file-based scripting in the ruby filter provides code reuse and testability, there are stillÂ limitationsÂ compared to full blown Logstash plugins. The main one is lack of support for third-party libraries: if you need the custom ruby code to use a library that doesn't ship with Logstash, it's not possible to load it through the ruby filter."