I can pull json data using the following curl command successfully:
curl -H "Api-Token: xxxxxxxxxx" -H "Api-Secret: xxxxxxxxxxxxxxx" https://site.cyz10.local:443/api/v1/tags?page=1&page_size=10&type=ip
Below is the config I have created and seems to run without any errors but I'm not seeing the data populate into the index although the index gets created:
input {
http_poller {
urls => {
urlname => "https://site.cyz10.local:443/api/v1/tags?page=1&page_size=10&type=ip"
headers => {
Accept => "application/json"
API-Token => "xxxxxxxxxx"
API-Secret => "xxxxxxxxxx"
}
}
}
}
request_timeout => 60
#schedule => { every => "20s"}
codec => "json"
metadata_target => "http_poller_metadata"
}
}
output {
elasticsearch {
hosts => ["localhost:9200"]
index => "logstash_http_poller"
}
stdout {
codec => rubydebug
}
}
Any help with this would be much appreciated. Thanks in advance.