I was given some inline ruby code to do some work for me. I've put it to good use but it makes my pipeline very messy and had a couple questions. First, here's what this part of the pipe looks like right now:
Well no, it's not necessarily the [extended_tweet][full_text] field that thecode is running on. The IF statement looks for that field and if present runs the three lines of ruby. If the field is not present, it runs the three lines of ruby code on the [text] field. So the error could be occurring on either one.
All events will have text, some events will have extended_tweet.full_text. When extended_tweet.full_text is present, I need to perform actions on it and text. When it is not, then only operations on text are performed. Regardless of field presence, values for each ruby code may or may not be present.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.