Can optional elements be added to the RSS filter or any other filter?
Is there a way to find out about the rss filter and what elements it processes?
How about using Grok or Dissect?
You could follow the link that I put in my answer, which goes to the code in rss filter that extracts elements.
Conceptually the filter just does an HTTP get, which you could do with an http_poller input, and parses the XML result, which you could do with xml and split filters. Or you could modify the code of the input and build your own version.
Thanks for the help and Tips. To modify the RSS input filter can I just find and modify the existing rss.rb file on my system and test and use it to try any changes?
I hope someone else will answer this, but my understanding is that the logstash package includes Ruby "gem" packages, which in turn include both source and architecture specific binary.
If that is correct then modifying the source will not modify the binary that logstash loads.
The README at github for the rss filter is the boilerplate documentation for how to build your plugin (which I think assumes you forked the repo).
I found and modified the RSS filter source file RSS.RB and the changes I made were effective. Don't know if the source got auto compiled or not. But It allowed me to grab a few more xml fields that I needed.
Thanks for the help!
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.