How filter twitter input data based on @timestamps field in logstash?

I want to filter twitter input data based on @timestamp field my mean just get new twitt of twiiter not old twitt,
any one help to how filter it with logstash-filter-date plugin

As far as I can tell from reading the plugin's source code, the @timestamp field already contains the time when the tweet was made. What you're trying to accomplish is essentially

if [@timestamp] is older than X days {
  drop { }
}

but the Logstash configuration language isn't that expressive. What you can do is have a ruby filter that checks the age of @timestamp and adds a tag that you can check the presence of. I don't know off the top of my head exactly what such a filter would look like so unless someone else steps in you'll have to do some digging.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.