# Filebeat is running but not sending logs to logstash

**URL:** https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276
**Category:** Beats
**Tags:** filebeat
**Created:** [February 23, 2018, 7:45pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276 "2018-02-23T19:45:17Z")
**Posts on this page:** 9
**Page:** 1

<div class="post-metadata">

### Author: ![jiten](https://avatars.discourse-cdn.com/v4/letter/j/e9c0ed/32.png) [@jiten](https://discuss.elastic.co/u/jiten)
#### Post date: [February 23, 2018, 7:45pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/1 "2018-02-23T19:45:17Z")

</div>

Hi Team,

I am trying to setup filebeat on my centos 7 machine. filebeat is working fine but still not able to see any logs to [logz.io](http://logz.io).

filebeat.yml file configuration

```auto
filebeat.prospectors:
- type: log
  enabled: true
  paths: ['/tm/logs/dataio/default/logstash.json']
  fields:
    logzio_codec: json
   
  fields_under_root: true
  encoding: utf-8

# Exclude fields
processors:
 - drop_fields:
    fields: ["beat.name", "beat.hostname", "beat.version"]

#-------------------------- Elasticsearch output ------------------------------
output:
  logstash:
    hosts: ["listener.logz.io:5015"]

# The below configuration is used for Filebeat 1.3 or lower
    # tls:
    # certificate_authorities: ['/etc/pki/tls/certs/COMODORSADomainValidationSecureServerCA.crt']

# The below configuration is used for Filebeat 5.0 or higher
    ssl:
      certificate_authorities: ['/etc/pki/tls/certs/COMODORSADomainValidationSecureServerCA.crt']/>

```

any one can help me?

Thanks  
Jitendra Bansal

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [February 23, 2018, 7:53pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/2 "2018-02-23T19:53:22Z")

</div>

The config looks normal to me. Were there any errors coming out of Filebeat? Can you check the Filebeat log?

---

<div class="post-metadata">

### Author: ![jiten](https://avatars.discourse-cdn.com/v4/letter/j/e9c0ed/32.png) [@jiten](https://discuss.elastic.co/u/jiten)
#### Post date: [February 23, 2018, 8:03pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/3 "2018-02-23T20:03:55Z")

</div>

yes i checked filebeat log file but did not see any error.

\<2018-02-23T18:09:17.357Z INFO instance/beat.go:468 Home path: [/usr/share/filebeat] Config path: [/etc/filebeat] Data path: [/var/lib/filebeat] Logs path: [/var/log/filebeat]  
2018-02-23T18:09:17.358Z INFO instance/beat.go:475 Beat UUID: 51e77e87-8056-4c11-a66d-1b1b7753c7e6  
2018-02-23T18:09:17.358Z INFO instance/beat.go:213 Setup Beat: filebeat; Version: 6.2.1  
2018-02-23T18:09:17.358Z INFO pipeline/module.go:76 Beat name: [stage1-servicenode1.aca1.tidemark.net](http://stage1-servicenode1.aca1.tidemark.net)  
2018-02-23T18:09:17.359Z INFO [monitoring] log/log.go:97 Starting metrics logging every 30s  
2018-02-23T18:09:17.359Z INFO instance/beat.go:301 filebeat start running.  
2018-02-23T18:09:17.359Z INFO registrar/registrar.go:108 Loading registrar data from /var/lib/filebeat/registry  
2018-02-23T18:09:17.359Z INFO registrar/registrar.go:119 States Loaded from registrar: 22  
2018-02-23T18:09:17.359Z WARN beater/filebeat.go:261 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.  
2018-02-23T18:09:17.359Z INFO crawler/crawler.go:48 Loading Prospectors: 1  
2018-02-23T18:09:17.360Z INFO log/prospector.go:111 Configured paths: [/tm/logs/dataio/default/logstash.json]  
2018-02-23T18:09:17.360Z INFO crawler/crawler.go:82 Loading and starting Prospectors completed. Enabled prospectors: 1  
2018-02-23T18:09:47.360Z INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":10,"time":16},"total":{"ticks":20,"time":27,"value":20},"user":{"ticks":10,"time":11}},"info":{"ephemeral\_id":"248a9c2f-5a4c-44a1-ac01-76253741f487","uptime":{"ms":30009}},"memstats":{"gc\_next":4473924,"memory\_alloc":2939104,"memory\_total":2939104,"rss":14442496}},"filebeat":{"harvester":{"open\_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"output":{"type":"logstash"},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"cpu":{"cores":16},"load":{"1":0,"15":0.09,"5":0.05,"norm":{"1":0,"15":0.0056,"5":0.0031}}}}}}  
2018-02-23T18:10:17.360Z INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":10,"time":18},"total":{"ticks":20,"time":29,"value":20},"user":{"ticks":10,"time":11}},"info":{"ephemeral\_id":"248a9c2f-5a4c-44a1-ac01-76253741f487","uptime":{"ms":60009}},"memstats":{"gc\_next":4473924,"memory\_alloc":3140368,"memory\_total":3140368}},"filebeat":{"harvester":{"open\_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":0,"15":0.09,"5":0.04,"norm":{"1":0,"15":0.0056,"5":0.0025}}}}}}/\>

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [February 23, 2018, 9:14pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/4 "2018-02-23T21:14:23Z")

</div>

Based on the metrics output. Filebeat is not harvesting any files.

```auto
      "filebeat": {
        "harvester": {
          "open_files": 0,
          "running": 0
        }
      },

```

The file you have configured probably does not exists.

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [February 23, 2018, 9:14pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/5 "2018-02-23T21:14:49Z")

</div>

> [@jiten](#):
>
> /tm/logs/dataio/default/logstash.json

Is that supposed to be `/tmp`?

---

<div class="post-metadata">

### Author: ![jiten](https://avatars.discourse-cdn.com/v4/letter/j/e9c0ed/32.png) [@jiten](https://discuss.elastic.co/u/jiten)
#### Post date: [February 23, 2018, 10:08pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/6 "2018-02-23T22:08:14Z")

</div>

no, file path is correct, this file /tm/logs/dataio/default/logstash.json exist and it have data inside it.

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [February 23, 2018, 10:19pm UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/7 "2018-02-23T22:19:32Z")

</div>

Could you please post the log output again, but with debug enabled?

```auto
# Debug logging config.
logging.level: debug
logging.selectors: ['*']

```

---

<div class="post-metadata">

### Author: ![jiten](https://avatars.discourse-cdn.com/v4/letter/j/e9c0ed/32.png) [@jiten](https://discuss.elastic.co/u/jiten)
#### Post date: [February 28, 2018, 12:25am UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/8 "2018-02-28T00:25:53Z")

</div>

Hi Andrew,

Thanks for looking into the issue, but it is working now.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 28, 2018, 12:25am UTC](https://discuss.elastic.co/t/filebeat-is-running-but-not-sending-logs-to-logstash/121276/9 "2018-03-28T00:25:58Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
