How filter twitter input data based on @timestamps field in logstash?


(jamal ) #1

I want to filter twitter input data based on @timestamp field my mean just get new twitt of twiiter not old twitt,
any one help to how filter it with logstash-filter-date plugin


(Magnus B├Ąck) #2

As far as I can tell from reading the plugin's source code, the @timestamp field already contains the time when the tweet was made. What you're trying to accomplish is essentially

if [@timestamp] is older than X days {
  drop { }
}

but the Logstash configuration language isn't that expressive. What you can do is have a ruby filter that checks the age of @timestamp and adds a tag that you can check the presence of. I don't know off the top of my head exactly what such a filter would look like so unless someone else steps in you'll have to do some digging.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.