How filter twitter input data based on @timestamps field in logstash?

Elastic Stack Logstash
1

I want to filter twitter input data based on @timestamp field my mean just get new twitt of twiiter not old twitt,
any one help to how filter it with logstash-filter-date plugin

2

As far as I can tell from reading the plugin's source code, the @timestamp field already contains the time when the tweet was made. What you're trying to accomplish is essentially

if [@timestamp] is older than X days {
  drop { }
}

but the Logstash configuration language isn't that expressive. What you can do is have a ruby filter that checks the age of @timestamp and adds a tag that you can check the presence of. I don't know off the top of my head exactly what such a filter would look like so unless someone else steps in you'll have to do some digging.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.