Hi ,
I want data from table from servicenow(ITSM tool) into elasticsearch. So I am using http_poller plugin to get the data from servicenow REST API. I am executing command logstash -f D:\ELK\Input\http_poller.conf:
After this, Index is getting generated in elasticsearch but there is not table data. and in debug mode , it showing this log:
[2018-04-18T11:48:10,343][DEBUG][logstash.pipeline ] filter received {"event"=>{"@version"=>"1", "tags"=>["_http_request_failure"], "http_request_failure"=>{"error"=>"connect timed out", "backtrace"=>nil, "runtime_seconds"=>10.01, "request"=>{"headers"=>{"Accept"=>"application/json"}, "auth"=>{"eager"=>true, "pass"=>"abc", "user"=>"abc"}, "method"=>"get", "url"=>"https://dev****.service-now.com/api/now/table/mytable"}, "name"=>"test"}, "@timestamp"=>2018-04-18T06:18:10.240Z}}
[2018-04-18T11:48:10,345][DEBUG][logstash.pipeline ] output received {"event"=>{"@version"=>"1", "tags"=>["_http_request_failure"], "http_request_failure"=>{"error"=>"connect timed out", "backtrace"=>nil, "runtime_seconds"=>10.01, "request"=>{"headers"=>{"Accept"=>"application/json"}, "auth"=>{"eager"=>true, "pass"=>"abc", "user"=>"abc"}, "method"=>"get", "url"=>"https://dev****.service-now.com/api/now/table/mytable"}, "name"=>"test"}, "@timestamp"=>2018-04-18T06:18:10.240Z}}
2018-04-18T06:18:10.240Z %{host} %{message}
My http_poller.conf file:
input {
http_poller {
urls => {
test => {
method => get
user => "abc"
password => "abc"
url => "https://dev****.service-now.com/api/now/table/mytable"
proxy => { host => "myhost" port => 8080}
headers => {
Accept => "application/json"
}
}
}
request_timeout => 300
schedule => { cron => "*/02 * * * * UTC"}
}
}
output
{
elasticsearch {
hosts => ["localhost:9200"]
index => "new_data"
}
stdout{}
}
Please provide any possible solution. Thank you!