i have a logstash http filter that reaches out to a public API for enrichment of the data. i'm limited to 1 request per second.
i've thrown a "sleep" filter in.. to make it wait 1 second.. i'm still getting "request limit reached" i'm guessing because logstash is multi-threaded and sending more than one request at a time.
the only solution i can thing of is making thje sleep a random amount between 1-10 seconds.. so each threat waits a different amount of time.
is there a way to do this easily?
time => %[random number between 1 and 10]%
every => "1"
i hope that makes sense