Hi,
I'm using http_poller in the input block and http in the filter block to do REST API calls, they are working fine.
But recently we have observed variations in the output. I'm running the calls every 5 minutes. I have written the code in such a way that end time of first call is the start time of second call for REST API.
When i see the output, I'm seeing that some of the events are being missed. if there are 50 events in the application, then my calls are pulling 40. Is there something which I should take care of here in the plugins? Or I need to change any values?
Below is the code:
input {
http_poller {
urls => {
token => {
method => post
url => "url"
headers => {
"Authorization" => "Basic token"
}
}
}
request_timeout => 120
connect_timeout => 60
socket_timeout => 60
automatic_retries => 2
schedule => { "every" => "5m" }
metadata_target => "REST_Response"
}
}
filter
{
http
{
url => "url?start_time=%{startTime}"
headers => {
"Accept" => "application/json"
"Token" => "%{token}"
}
target_body => "Response_data"
connect_timeout => 60
socket_timeout => 60
automatic_retries => 2
request_timeout => 120
}
}