# Polling with logstash using http\_poller

**URL:** <https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709>\
**Category:** Logstash\
**Created:** [November 7, 2017, 2:55pm UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709 "2017-11-07T14:55:28Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![citanionarrei](https://avatars.discourse-cdn.com/v4/letter/c/da6949/32.png) [@citanionarrei](https://discuss.elastic.co/u/citanionarrei)\
**Post date:** [November 7, 2017, 2:55pm UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/1 "2017-11-07T14:55:28Z")

</div>

hi friends  
i'm trying to make the polling of json log from this site  
[http://stream.meetup.com/2/rsvps](http://stream.meetup.com/2/rsvps)

```
input 
{

http_poller {
 urls => {
  myurl => "http://stream.meetup.com/2/rsvps"
 }
 
 interval => 5
 }

}

```

but the jsons doesn't enter on elastic  
where do i wrong?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [November 9, 2017, 9:56pm UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/2 "2017-11-09T21:56:37Z")

</div>

- Are you getting anything from Logstash if you comment out the the elasticsearch output and just use a `stdout { codec => rubydebug }` output?
- Are you getting any error messages in the Logstash log?
- How can you be sure nothing's in Elasticsearch? Do you have X-Pack enabled?

---

<div class="post-metadata">

**Author:** ![citanionarrei](https://avatars.discourse-cdn.com/v4/letter/c/da6949/32.png) [@citanionarrei](https://discuss.elastic.co/u/citanionarrei)\
**Post date:** [November 10, 2017, 10:44am UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/3 "2017-11-10T10:44:59Z")

</div>

> [@citanionarrei](#):
>
> http\_poller {  
> urls =\> {  
> myurl =\> "[http://stream.meetup.com/2/rsvps](http://stream.meetup.com/2/rsvps)"  
> }
> 
> interval =\> 5  
> }

hi  
i'm using this configuration

```
input 
{ http_poller {
	urls => {
	myurl => "http://stream.meetup.com/2/rsvps"}
	interval => 5
}
}

filter{
grok {
match => ["message", "(?<meetup>{\".*\".*})"]
break_on_match => true
add_field => { "type" => "log"} 
}
if "_grokparsefailure" in [tags]{drop {}}	
else {json {source => "meetup"}	 

mutate {

	 add_field => { "[location]" => "%{[venue][lat]},%{[venue][lon]}"}
   }

 kv {
	source => "location"
	target => "location"
	field_split => ","}  
   
 mutate {
	convert => { "[location][lat]" => "float" }
	convert => { "[location][lon]" => "float" }
   
   }
  }
}		

output
{ elasticsearch {

index => "meetup1-%{+YYYY.MM.dd}"
document_type => "log"
manage_template => true
template_name => "test"
template => "C:\Users\Lock\Desktop\meetup_polling\template1.json"
template_overwrite => true
codec => json
}

stdout { codec => rubydebug }}

```

i have not x-pack enabled

on the terminal i see this:

 ![Screenshot (63)](https://us1.discourse-cdn.com/elastic/original/3X/9/f/9f296b10b90f534cc3d34a11ea1e2fdbebbb07b1.png) ![Screenshot (62)](https://us1.discourse-cdn.com/elastic/original/3X/d/5/d54aa96a3b85fc93057c069115aa312e04229bb2.png)

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [November 13, 2017, 6:19am UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/4 "2017-11-13T06:19:59Z")

</div>

Perhaps your grok filter is failing and you're dropping all events?

Either way, debug your configuration systematically by starting small and adding complexity once you've verified that what you have is working as expected.

---

<div class="post-metadata">

**Author:** ![citanionarrei](https://avatars.discourse-cdn.com/v4/letter/c/da6949/32.png) [@citanionarrei](https://discuss.elastic.co/u/citanionarrei)\
**Post date:** [November 15, 2017, 4:30pm UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/5 "2017-11-15T16:30:05Z")

</div>

the grok filter usually work properly..  
i changed only imput filter from file{} (with the json date from meetup) to http{}  
the data are identical

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 13, 2017, 4:30pm UTC](https://discuss.elastic.co/t/polling-with-logstash-using-http-poller/106709/6 "2017-12-13T16:30:08Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.