# Logstash http poller multiple URL's - output random from any 3 URL's

**URL:** <https://discuss.elastic.co/t/logstash-http-poller-multiple-urls-output-random-from-any-3-urls/151042>\
**Category:** Logstash\
**Created:** [October 4, 2018, 12:15pm UTC](https://discuss.elastic.co/t/logstash-http-poller-multiple-urls-output-random-from-any-3-urls/151042 "2018-10-04T12:15:47Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Harish\_Malu](https://avatars.discourse-cdn.com/v4/letter/h/9dc877/32.png) [@Harish\_Malu](https://discuss.elastic.co/u/Harish_Malu)\
**Post date:** [October 4, 2018, 12:15pm UTC](https://discuss.elastic.co/t/logstash-http-poller-multiple-urls-output-random-from-any-3-urls/151042/1 "2018-10-04T12:15:47Z")

</div>

I have an logstash pipeline with http poller urls. Each urls will send JSON data for a given server name.  
Below is my conf -

input {  
http\_poller {  
urls =\> {  
servsb =\> "[http://servsb:8003/servmetric/json/](http://servsb:8003/servmetric/json/)"  
servsd =\> "[http://servsd:8003/servmetric/json/](http://servsd:8003/servmetric/json/)"  
servsf =\> "[http://servsf:8003/servmetric/json/](http://servsf:8003/servmetric/json/)"  
servsr =\> "[http://servsr:8003/servmetric/json/](http://servsr:8003/servmetric/json/)"

```
}
automatic_retries => 3
schedule => { cron => "*/5 * * * *"}
"codec" => "json_lines"

```

}  
}  
filter {  
date {  
match =\> ["metric\_starttime","YYYY-MM-dd HH:mm:ss"]  
remove\_field =\> ["metric\_starttime"]  
target =\> "metric\_starttime\_ts"  
}  
}  
output {  
stdout {  
"codec" =\> "rubydebug"  
}  
}

So I am expecting that every 5 min, I should get 4 outputs. However, the output seems random in sequence of number of json output as below -

1st interval data  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:21:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsr ",  
"server\_online\_gp" =\> 8,  
"@timestamp" =\> 2018-10-04T11:30:00.629Z  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:21:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsd ",  
"server\_online\_gp" =\> 9,  
"@timestamp" =\> 2018-10-04T11:30:00.631Z  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:21:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsf ",  
"server\_online\_gp" =\> 10,  
"@timestamp" =\> 2018-10-04T11:30:00.631Z  
}

2nd interval data

{  
"metric\_starttime\_ts" =\> 2018-10-04T11:21:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsb ",  
"server\_online\_gp" =\> 9,  
"@timestamp" =\> 2018-10-04T11:35:00.140Z,  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:26:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsb ",  
"server\_online\_gp" =\> 9,  
"@timestamp" =\> 2018-10-04T11:35:00.161Z,  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:26:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsf ",  
"server\_online\_gp" =\> 10,  
"@timestamp" =\> 2018-10-04T11:35:00.173Z,  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:26:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsd ",  
"server\_online\_gp" =\> 9,  
"@timestamp" =\> 2018-10-04T11:35:00.175Z  
}

3rd interval data  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:31:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsd ",  
"server\_online\_gp" =\> 9,  
"@timestamp" =\> 2018-10-04T11:40:00.135Z  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:26:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsr ",  
"server\_online\_gp" =\> 8,  
"@timestamp" =\> 2018-10-04T11:40:00.135Z  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:31:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsf ",  
"server\_online\_gp" =\> 10,  
"@timestamp" =\> 2018-10-04T11:40:00.139Z  
}  
{  
"metric\_starttime\_ts" =\> 2018-10-04T11:31:00.000Z,  
"@version" =\> "1",  
"servername" =\> "servsr ",  
"server\_online\_gp" =\> 8,  
"@timestamp" =\> 2018-10-04T11:40:00.145Z  
}

So basically in  
1st interval - got data for servsr, servsd and servsf (so servsb missing)  
2nd interval - got data for servsb (of 1st interval), servsb (current interval), servsf and servsd (servsr missing)  
3rd interval - got data for servsd, servsr (2nd interval), servsf and servsr (for current interval) so servsb missing

So data gets collected and is not missed, however it's not coming in the correct server.

Can you please help.

Regards,  
Harish

---

<div class="post-metadata">

**Author:** ![Harish\_Malu](https://avatars.discourse-cdn.com/v4/letter/h/9dc877/32.png) [@Harish\_Malu](https://discuss.elastic.co/u/Harish_Malu)\
**Post date:** [October 9, 2018, 6:57am UTC](https://discuss.elastic.co/t/logstash-http-poller-multiple-urls-output-random-from-any-3-urls/151042/2 "2018-10-09T06:57:41Z")

</div>

Please let me know if the issues is not clear or need more details ?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 6, 2018, 7:02am UTC](https://discuss.elastic.co/t/logstash-http-poller-multiple-urls-output-random-from-any-3-urls/151042/3 "2018-11-06T07:02:52Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.