# Not getting logs from filebeat at logstash

**URL:** <https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [July 26, 2016, 1:46pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402 "2016-07-26T13:46:14Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Saurabh\_Jambhule](https://avatars.discourse-cdn.com/v4/letter/s/c0e974/32.png) [@Saurabh\_Jambhule](https://discuss.elastic.co/u/Saurabh_Jambhule)\
**Post date:** [July 26, 2016, 1:46pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/1 "2016-07-26T13:46:14Z")

</div>

There are some sample apache logs in folder listed in paths, but still they not going to logstash  
Here is my configuration,

_ **filebeat** :_

```auto
filebeat:
  prospectors:
    -
      paths:
        - /home/saurabh/sample-log/*.log"
      input_type: log
  registry_file: /var/lib/filebeat/registry

output:
  logstash:
    **hosts: ["localhost:5044"]**
  console:
    pretty: true

shipper:

logging:
  to_files: true
  files:
    path: /var/log/filebeat
    name: mybeat
    rotateeverybytes: 10485760 # = 10MB

```

_ **logstash** :_

```auto
input {
  beats {
    **port => 5044**
  }
  stdin { 
  }
}

filter{
  grok {
    match => ["message", "%{COMBINEDAPACHELOG}"]
  }
  date {
    match => ["timestamp", "dd/MMM/yyyy:HH:mm:ss Z"]
  }
  geoip {
    source => "clientip"
    target => "geoip"
    database => "/home/saurabh/Documents/GeoLiteCity.dat"
    add_field => ["[geoip][coordinates]", "%{[geoip][longitude]}"]
    add_field => ["[geoip][coordinates]", "%{[geoip][latitude]}"]
  }
  mutate {
    convert => ["[geoip][coordinates]", "float"]
  }
}

output {
  stdout {
    codec => rubydebug
  }
  elasticsearch {
    manage_template => false
    **hosts => "localhost:9200"**
  }
}

```

**_My system config:_**  
ubuntu\_16.04  
filebeat\_1.2.3\_amd64  
elasticsearch-2.3.4  
logstash\_2.3.4-1\_all  
kibana\_4.5.2\_amd64

Thank you.

---

<div class="post-metadata">

**Author:** ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)\
**Post date:** [July 26, 2016, 2:10pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/2 "2016-07-26T14:10:57Z")

</div>

Try these steps to collect some debug logging information from Filebeat:

1. Delete your Filebeat registry file to clear any state kept by Filebeat. Run `rm /var/lib/filebeat/registry`
2. Start Filebeat in the foreground and write debug to the console. Run `filebeat -c path/to/your/filebeat.yml -e -v -d "*"`

---

<div class="post-metadata">

**Author:** ![Saurabh\_Jambhule](https://avatars.discourse-cdn.com/v4/letter/s/c0e974/32.png) [@Saurabh\_Jambhule](https://discuss.elastic.co/u/Saurabh_Jambhule)\
**Post date:** [July 27, 2016, 1:15pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/3 "2016-07-27T13:15:41Z")

</div>

I got following output :

```
2016/07/27 13:09:42.777629 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths
2016/07/27 13:09:42.777713 logstash.go:106: INFO Max Retries set to: 3
2016/07/27 13:09:42.777894 outputs.go:126: INFO Activated logstash as output plugin.
2016/07/27 13:09:42.777914 outputs.go:126: INFO Activated console as output plugin.
2016/07/27 13:09:42.777962 publish.go:288: INFO Publisher name: saurabh
2016/07/27 13:09:42.792453 async.go:78: INFO Flush Interval set to: 1s
2016/07/27 13:09:42.792465 async.go:84: INFO Max Bulk Size set to: 1024
2016/07/27 13:09:42.792521 async.go:78: INFO Flush Interval set to: 1s
2016/07/27 13:09:42.792525 async.go:84: INFO Max Bulk Size set to: 2048
2016/07/27 13:09:42.792564 beat.go:147: INFO Init Beat: filebeat; Version: 1.2.3
2016/07/27 13:09:42.792830 beat.go:173: INFO filebeat sucessfully setup. Start running.
2016/07/27 13:09:42.792855 registrar.go:68: INFO Registry file set to: /var/lib/filebeat/registry
2016/07/27 13:09:42.792867 prospector.go:133: INFO Set ignore_older duration to 0
2016/07/27 13:09:42.792871 prospector.go:133: INFO Set close_older duration to 1h0m0s
2016/07/27 13:09:42.792876 prospector.go:133: INFO Set scan_frequency duration to 10s
2016/07/27 13:09:42.792881 prospector.go:93: INFO Input type set to: log
2016/07/27 13:09:42.792886 prospector.go:133: INFO Set backoff duration to 1s
2016/07/27 13:09:42.792890 prospector.go:133: INFO Set max_backoff duration to 10s
2016/07/27 13:09:42.792901 prospector.go:113: INFO force_close_file is disabled
2016/07/27 13:09:42.792911 prospector.go:143: INFO Starting prospector of type: log
2016/07/27 13:09:42.792950 crawler.go:78: INFO All prospectors initialised with 0 states to persist
2016/07/27 13:09:42.792956 registrar.go:87: INFO Starting Registrar
2016/07/27 13:09:42.792966 publish.go:88: INFO Start sending events to output
2016/07/27 13:09:42.792979 spooler.go:77: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s

```

Still logs are not going into logstash.

---

<div class="post-metadata">

**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\
**Post date:** [July 27, 2016, 2:11pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/4 "2016-07-27T14:11:47Z")

</div>

That seems to be only the setup phase. Can you share some more content?

---

<div class="post-metadata">

**Author:** ![Saurabh\_Jambhule](https://avatars.discourse-cdn.com/v4/letter/s/c0e974/32.png) [@Saurabh\_Jambhule](https://discuss.elastic.co/u/Saurabh_Jambhule)\
**Post date:** [July 27, 2016, 2:17pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/5 "2016-07-27T14:17:47Z")

</div>

Its working now. I mistakenly put double quotation at end of path  
`- /home/saurabh/sample-log/*.log"`  
Thank you!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 16, 2016, 1:46pm UTC](https://discuss.elastic.co/t/not-getting-logs-from-filebeat-at-logstash/56402/6 "2016-08-16T13:46:20Z")

</div>

This topic was automatically closed after 21 days. New replies are no longer allowed.
