# Cannot see Filebeats - logstash data in Kibana

**URL:** https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053
**Category:** Beats
**Tags:** filebeat
**Created:** [June 12, 2017, 1:54pm UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053 "2017-06-12T13:54:47Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![priyam](https://avatars.discourse-cdn.com/v4/letter/p/9fc29f/32.png) [@priyam](https://discuss.elastic.co/u/priyam)
#### Post date: [June 12, 2017, 1:54pm UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/1 "2017-06-12T13:54:47Z")

</div>

I have configured Filebeat to send data to logstash and logstash sends data to elasticsearch.

Nothing appears in logstash-\* in kibana .. neither is there any data in filebeats-\*.

**Filebeat.yml:**

> filebeat.prospectors:
> 
> - input\_type: log  
> paths:  
> #- /var/log/\*.log
> - D:\ELKWorkspace\ELK1.mule\logs\elk2.log
> - D:\ELK\logs\Poornima\CKServer.log  
> exclude\_lines: ["^DBG"]  
> include\_lines: ["^ERR", "^WARN", "^INFO"]

> output.logstash:
> 
> # The Logstash hosts
> 
> hosts: ["localhost:5044"]

**logstash.conf**

> input {  
> beats {  
> port =\> 5044  
> }  
> }

> output {  
> elasticsearch {  
> hosts =\> "localhost:9200"  
> manage\_template =\> false  
> index =\> "%{[@metadata][beat]}-%{+YYYY.MM.dd}"  
> document\_type =\> "%{[@metadata][type]}"  
> }  
> }

Am not sure whether input port in logstash should be 5044 or 5043. Both do not work. However, Following are the console logs:

**Beats**

 ![](https://us1.discourse-cdn.com/elastic/original/3X/1/e/1e31cd06bf8716884411c3d14c1d0605b3f66ef4.PNG)

**logstash**

 ![](https://us1.discourse-cdn.com/elastic/original/3X/f/7/f7a96545f800fa0adf2d767df2e68b018e8e1023.PNG)

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [June 12, 2017, 10:56pm UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/2 "2017-06-12T22:56:48Z")

</div>

Based on your configuration, the data will be written to filebeat-YYYY.MM.DD indices. What does this query return?

`curl http://localhost:9200/_cat/indices?v`

---

<div class="post-metadata">

### Author: ![priyam](https://avatars.discourse-cdn.com/v4/letter/p/9fc29f/32.png) [@priyam](https://discuss.elastic.co/u/priyam)
#### Post date: [June 13, 2017, 3:13am UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/3 "2017-06-13T03:13:35Z")

</div>

@andrewkroh .. it returns ..

 ![](https://us1.discourse-cdn.com/elastic/original/3X/2/5/25fb948ac49d0bffc9a828fe181f1fe6db22ae85.png)

I have pasted the configuration of logstash and filebeat for reference ... do I need to alter/add something in it?

---

<div class="post-metadata">

### Author: ![priyam](https://avatars.discourse-cdn.com/v4/letter/p/9fc29f/32.png) [@priyam](https://discuss.elastic.co/u/priyam)
#### Post date: [June 13, 2017, 7:13am UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/4 "2017-06-13T07:13:58Z")

</div>

Further i think logstash is not sending the data received from filebeat to elasticsearch...

 ![](https://us1.discourse-cdn.com/elastic/original/3X/d/5/d5abf7d46e992e9cac1cf08f4454fc95fd71a933.png)

![](https://us1.discourse-cdn.com/elastic/original/3X/e/c/ec4f4d5598877b13dbb2a9b24301e13433d11376.png)

---

<div class="post-metadata">

### Author: ![priyam](https://avatars.discourse-cdn.com/v4/letter/p/9fc29f/32.png) [@priyam](https://discuss.elastic.co/u/priyam)
#### Post date: [June 13, 2017, 12:22pm UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/5 "2017-06-13T12:22:00Z")

</div>

My issue is resolved.. in case someone is facing the same prob.

1. In logstash.conf, remove

> manage\_template =\> false  
> index =\> "%{[@metadata][beat]}-%{+YYYY.MM.dd}"  
> document\_type =\> "%{[@metadata][type]}"

1. In Filebeat, modify  
include\_lines: ["^ERR", "^WARN", "^INFO"]  
as  
include\_lines: ["ERR", "WARN", "INFO"]

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 11, 2017, 12:22pm UTC](https://discuss.elastic.co/t/cannot-see-filebeats-logstash-data-in-kibana/89053/6 "2017-07-11T12:22:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.