# Filebeat-logstash issue

**URL:** <https://discuss.elastic.co/t/filebeat-logstash-issue/259576>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [December 24, 2020, 10:09am UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576 "2020-12-24T10:09:12Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![mustafa.husny](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mustafa.husny/32/77154_2.png) [@mustafa.husny](https://discuss.elastic.co/u/mustafa.husny)\
**Post date:** [December 24, 2020, 10:09am UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576/1 "2020-12-24T10:09:12Z")

</div>

I am using ELK 7.6.2  
I have three piplines  
first for the heartbeat  
second for the tcp to forward logs from QRadar  
Third is for filebeat  
I am receiving logs from heartbeat and qradar, but when I installed filebeat on windows machine I can not receive logs from it

my filebeat config

> #=========================== Filebeat inputs =============================
> 
> filebeat.inputs:
> 
> # Each - is an input. Most options can be set at the input level, so
> 
> # you can use different inputs for various configurations.
> 
> # Below are the input specific configurations.
> 
> - type: log
> 
> #============================= Filebeat modules ===============================
> 
> filebeat.config.modules:
> 
> # Glob pattern for configuration loading
> 
> path: ${path.config}/modules.d/\*.yml
> 
> # Set to true to enable config reloading
> 
> reload.enabled: false
> 
> # Period on which files under path should be checked for changes
> 
> #reload.period: 10s
> 
> #----------------------------- Logstash output --------------------------------  
> output.logstash:
> 
> # The Logstash hosts
> 
> hosts: ["ELK:5044"]

logstash pipline for filebeat

> ```
> input {
> beats {
> port => 5044
> ssl => false
> }
> }
> 
> output {
> elasticsearch {
> hosts => ["http://elk:9200"]
> index => "logs-%{[host][name]}-%{IP}-%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}"
> user => "elastic"
> password => "mypassword"
> }
> }
> 
> ```

piplines.conf file

> ```
> pipeline.id: main
> path.config: "/etc/logstash/conf.d/filebeat.conf"
> 
> pipeline.id: heartbeat
> path.config: "/etc/logstash/conf.d/heartbeat.conf"
> 
> pipeline.id: qradar
> path.config: "/etc/logstash/conf.d/qradar.conf"
> 
> ```

I start the service using systemctl

I can telnet from my windows machine to ELK machine on port 5044

sample of filebeat logs

art the service using systemctl

I can telnet from my windows machine to ELK machine on port 5044

sample of filebeat logs

> ```
> 2020-12-21T15:10:46.218+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":311,"time":{"ms":16},"value":311},"user":{"ticks":249,"time":{"ms":16}}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1382417}},"memstats":{"gc_next":9814304,"memory_alloc":4971112,"memory_total":15764888,"rss":8192},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:11:16.219+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1412417}},"memstats":{"gc_next":9814304,"memory_alloc":5010584,"memory_total":15804360},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:11:46.219+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1442416}},"memstats":{"gc_next":9814304,"memory_alloc":5055768,"memory_total":15849544,"rss":4096},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:12:16.219+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1472416}},"memstats":{"gc_next":9819616,"memory_alloc":4908352,"memory_total":15898536,"rss":-126976},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:12:46.219+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1502416}},"memstats":{"gc_next":9819616,"memory_alloc":4963368,"memory_total":15953552},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:13:16.219+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1532416}},"memstats":{"gc_next":9819616,"memory_alloc":5005096,"memory_total":15995280},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:13:46.220+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":327,"value":327},"user":{"ticks":265}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1562418}},"memstats":{"gc_next":9819616,"memory_alloc":5055416,"memory_total":16045600},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:14:16.220+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":342,"time":{"ms":15},"value":342},"user":{"ticks":280,"time":{"ms":15}}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1592416}},"memstats":{"gc_next":9814304,"memory_alloc":4911088,"memory_total":16093632,"rss":4096},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:14:46.220+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":342,"value":342},"user":{"ticks":280}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1622417}},"memstats":{"gc_next":9814304,"memory_alloc":4961272,"memory_total":16143816},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 2020-12-21T15:15:16.220+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":62},"total":{"ticks":342,"value":342},"user":{"ticks":280}},"handles":{"open":169},"info":{"ephemeral_id":"fc74c7bf-bf32-4fc8-ae14-8bd53d923764","uptime":{"ms":1652416}},"memstats":{"gc_next":9814304,"memory_alloc":5007304,"memory_total":16189848},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
> 
> ```

I can not find index in kibana to create index pattern  
Tried to check traffic using tcpdump utility but I can not receive any traffic

I posted the same post in logstash section but no one gives me help so I am trying her

please please advice

---

<div class="post-metadata">

**Author:** ![TheHunter1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thehunter1/32/80190_2.png) [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Post date:** [December 24, 2020, 10:39am UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576/2 "2020-12-24T10:39:07Z")

</div>

- Did you restart Logstash after configuring the filebeat module ? as you are setting `reload.enabled: false`

- Can you show your Logsatsh logs after a restart ?

---

<div class="post-metadata">

**Author:** ![mustafa.husny](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mustafa.husny/32/77154_2.png) [@mustafa.husny](https://discuss.elastic.co/u/mustafa.husny)\
**Post date:** [December 24, 2020, 12:55pm UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576/3 "2020-12-24T12:55:57Z")

</div>

Sure logstash restarted and the port is open and all piplines are running (logstash status)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 21, 2021, 2:56pm UTC](https://discuss.elastic.co/t/filebeat-logstash-issue/259576/4 "2021-01-21T14:56:16Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
