# Filebeat-unable-to-send-logs-to-kafka

**URL:** <https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [April 17, 2019, 10:31am UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272 "2019-04-17T10:31:28Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![bomba](https://avatars.discourse-cdn.com/v4/letter/b/df705f/32.png) [@bomba](https://discuss.elastic.co/u/bomba)\
**Post date:** [April 17, 2019, 10:31am UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272/1 "2019-04-17T10:31:28Z")

</div>

File Beat is unable to send logs from a particular folder, This is the application logs folder.

Things that have been tried :

- Created a new topic in kafka to retest the settings.
- Checked for file permission for the folder and the file to send.
- Updated to the filebeats to 6.7 from 5.5
- changed from filebeat.prospector to filebeat.inputs

**Running Configuration**

```
filebeat.inputs:
- type: log
  paths:
    - /var/log/containers/*.log
fields_under_root: true
output.kafka:
  hosts: ["10.0.0.0:9092"]
  topic: "testtopic"
  codec.json:
    pretty: true

```

With this i am able to see all the logs in "testtopic"

**Not running Configuration :**

```
filebeat.inputs:
- type: log
  paths:
    - /app/log/server/*.log
fields_under_root: true
output.kafka:
  hosts: ["10.0.0.0:9092"]
  topic: "testtopic"
  codec.json:
    pretty: true

```

Expected Results : Logs from the path /app/log/server/\*.log should be sent to Kafka

---

<div class="post-metadata">

**Author:** ![shaunak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaunak/32/6643_2.png) [@shaunak](https://discuss.elastic.co/u/shaunak)\
**Post date:** [April 17, 2019, 4:54pm UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272/2 "2019-04-17T16:54:02Z")

</div>

Looks like the only difference between the "running" and "not running" configurations is the path to the logs folder. Could you start up Filebeat with the "non running" configuration and post the first 50 or so Filebeat log lines here? **Please be sure to redact any sensitive information before posting.**

---

<div class="post-metadata">

**Author:** ![bomba](https://avatars.discourse-cdn.com/v4/letter/b/df705f/32.png) [@bomba](https://discuss.elastic.co/u/bomba)\
**Post date:** [April 18, 2019, 7:40am UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272/3 "2019-04-18T07:40:08Z")

</div>

Hi @shaunak,  
The issue have been resolved, The issue was that for the Volume Mounts for Kubernates.  
I have to mount the paticular volume to allow filebeat to process the logs forward.

Thanks for the response.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 16, 2019, 7:40am UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-logs-to-kafka/177272/4 "2019-05-16T07:40:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.