Get raw twitter message

Fernando_Macho · May 14, 2018, 4:10pm

Hi, I'm trying to get the raw message that the twitter plugin processes. This is possible?
The message field is empty and the plugin does not accept anything similar to metadata_enabled => true.

Thanks in advance

yaauie · May 14, 2018, 10:25pm

It looks like the best we have is enabling DEBUG-level logging to get the user's screen name and the tweet body (which is going to get you quite a bit of other noise too):

github.com

logstash-plugins/logstash-input-twitter/blob/master/lib/logstash/inputs/twitter.rb#L187


      @logger.error("Event generation error", :message => e.message, :exception => e.class.name, :backtrace => e.backtrace.take(10))
    end
  end
end


def ignore?(tweet)
  @ignore_retweets && tweet.retweet?
end


def from_tweet(tweet)
  @logger.debug? && @logger.debug("Got tweet", :user => tweet.user.screen_name, :text => tweet.text)
  if @full_tweet
    event = LogStash::Event.new(LogStash::Util.stringify_symbols(tweet.to_hash))
    event.timestamp = LogStash::Timestamp.new(tweet.created_at)
  else


    attributes = {
      LogStash::Event::TIMESTAMP => LogStash::Timestamp.new(tweet.created_at),
      "message" => tweet.full_text,
      "user" => tweet.user.screen_name,
      "client" => tweet.source,

There is also a full_tweet configuration option, which will expand the entire tweet into the event.

system · June 11, 2018, 10:25pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.