# Not able see data in Kibana? Is Logstash pushing to ES

**URL:** https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534
**Category:** Logstash
**Created:** [May 3, 2018, 10:21pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534 "2018-05-03T22:21:18Z")
**Posts on this page:** 9
**Page:** 1

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 3, 2018, 10:21pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/1 "2018-05-03T22:21:18Z")

</div>

I am new to ELK and working on the whole stack

Below are my configs:

vivsingh@blr-lvg2e:/etc/logstash/conf.d$ ls  
filter.conf input.conf output.conf

vivsingh@blr-lvg2e:/etc/logstash/conf.d$ cat input.conf output.conf filter.conf  
input  
{  
file {  
path =\> "/tmp/access\_log.log"  
start\_position =\> "beginning"  
}  
}

output {  
elasticsearch {  
hosts =\> ["localhost:9200"]  
}  
stdout { codec =\> rubydebug }  
}

filter {  
if [path] =~ "access" {  
mutate { replace =\> { "type" =\> "apache\_access" } }  
grok {  
match =\> { "message" =\> "%{COMBINEDAPACHELOG}" }  
}  
}  
date {  
match =\> ["timestamp" , "dd/MMM/yyyy:HH:mm:ss Z"]  
}  
}

output {  
elasticsearch {  
hosts =\> ["localhost:9200"]  
}  
stdout { codec =\> rubydebug }  
}

I am checking if something is pushed via  
vivsingh@blr-lvg2e:/etc/logstash/conf.d$ curl [http://localhost:9200/\_cat/indices?v](http://localhost:9200/_cat/indices?v)  
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size

What am I doing wrong the file has data in it:

vivsingh@blr-lvg2e:/etc/logstash/conf.d$ head /tmp/access\_log.log  
i64.242.88.10 - - [07/Mar/2004:16:05:49 -0800] "GET /twiki/bin/edit/Main/Double\_bounce\_sender?topicparent=Main.ConfigurationVariables HTTP/1.1" 401 12846  
64.242.88.10 - - [07/Mar/2004:16:06:51 -0800] "GET /twiki/bin/rdiff/TWiki/NewUserTemplate?rev1=1.3&rev2=1.2 HTTP/1.1" 200 4523  
64.242.88.10 - - [07/Mar/2004:16:10:02 -0800] "GET /mailman/listinfo/hsdivision HTTP/1.1" 200 6291  
64.242.88.10 - - [07/Mar/2004:16:11:58 -0800] "GET /twiki/bin/view/TWiki/WikiSyntax HTTP/1.1" 200 7352  
64.242.88.10 - - [07/Mar/2004:16:20:55 -0800] "GET /twiki/bin/view/Main/DCCAndPostFix HTTP/1.1" 200 5253  
64.242.88.10 - - [07/Mar/2004:16:23:12 -0800] "GET /twiki/bin/oops/TWiki/AppendixFileSystem?template=oopsmore¶m1=1.12¶m2=1.12 HTTP/1.1" 200 11382  
64.242.88.10 - - [07/Mar/2004:16:24:16 -0800] "GET /twiki/bin/view/Main/PeterThoeny HTTP/1.1" 200 4924  
64.242.88.10 - - [07/Mar/2004:16:29:16 -0800] "GET /twiki/bin/edit/Main/Header\_checks?topicparent=Main.ConfigurationVariables HTTP/1.1" 401 12851  
64.242.88.10 - - [07/Mar/2004:16:30:29 -0800] "GET /twiki/bin/attach/Main/OfficeLocations HTTP/1.1" 401 12851  
64.242.88.10 - - [07/Mar/2004:16:31:48 -0800] "GET /twiki/bin/view/TWiki/WebTopicEditTemplate HTTP/1.1" 200 3732

---

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 4, 2018, 9:41am UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/2 "2018-05-04T09:41:30Z")

</div>

Present stats..

vivsingh@blr-lvg2e:~$ curl [http://localhost:9200/\_cat/indices?v](http://localhost:9200/_cat/indices?v)  
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size  
green open .kibana SjYX9nKTRm2uJ2TumYeM2A 1 0 0 0 259b 259b

Do the output states that logstash is pushing data to ES? Doc count is zero

---

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 4, 2018, 2:50pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/3 "2018-05-04T14:50:17Z")

</div>

strace shows that logstash fails to send bulk to ES ans raised transport error on ruby:

872 write(5, "{:timestamp=\>"2018-05-04T09:33:46.439000-0400", :message=\>"Attempted to send a bulk request to Elasticsearch configured at '[\"[http://localhost:9200/\](http://localhost:9200/%5C)"]', but an error occurred and it failed! Are you sure you can reach elasticsearch from this machine using the configuration provided?", :error\_message=\>"[406] {\"error\":\"Content-Type header [text/plain; charset=UTF-8] is not supported\",\"status\":406}", :error\_class=\>"Elasticsearch::Transport::Transport::Errors::NotAcceptable", :backtrace=\>["/opt/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.15/lib/elasticsearch/transport/transport/base.rb:146:in `__raise_transport_error'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.15/lib/elasticsearch/transport/transport/base.rb:256:in`perform\_request'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.15/lib/elasticsearch/transport/transport/http/manticore.rb:54:in `perform_request'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-transport-1.0.15/lib/elasticsearch/transport/client.rb:125:in`perform\_request'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/elasticsearch-api-1.0.15/lib/elasticsearch/api/actions/bulk.rb:87:in `bulk'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/http_client.rb:53:in`non\_threadsafe\_bulk'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/http\_client.rb:38:in `bulk'\", \"org/jruby/ext/thread/Mutex.java:149:in`synchronize'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/http\_client.rb:38:in `bulk'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/common.rb:163:in`safe\_bulk'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/common.rb:101:in `submit'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/elasticsearch/common.rb:86:in`retrying\_submit'", "/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.5.5-java/lib/logstash/outputs/ela:

vivsingh@blr-lvg2e:~$ telnet localhost 9200  
Trying ::1...  
Connected to localhost.  
Escape character is '^]'.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [May 4, 2018, 2:55pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/4 "2018-05-04T14:55:13Z")

</div>

What versions of Logstash and Elasticsearch are you using?

---

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 4, 2018, 3:11pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/5 "2018-05-04T15:11:43Z")

</div>

vivsingh@blr-lvg2e:~$ curl "[http://localhost:9200](http://localhost:9200)"  
{  
"name" : "dYZlRnx",  
"cluster\_name" : "elasticsearch",  
"cluster\_uuid" : "nC3fodoPSUq93jhvtofAmw",  
"version" : {  
"number" : "6.2.4",  
"build\_hash" : "ccec39f",  
"build\_date" : "2018-04-12T20:37:28.497551Z",  
"build\_snapshot" : false,  
"lucene\_version" : "7.2.1",  
"minimum\_wire\_compatibility\_version" : "5.6.0",  
"minimum\_index\_compatibility\_version" : "5.0.0"  
},  
"tagline" : "You Know, for Search"  
}

Kibana version 6.2.4

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [May 4, 2018, 3:16pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/6 "2018-05-04T15:16:10Z")

</div>

What about Logstash version?

---

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 4, 2018, 3:22pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/7 "2018-05-04T15:22:49Z")

</div>

Okay guess here is the issue 🙂

vivsingh@blr-lvg2e:~$ /opt/logstash/bin/logstash --version  
logstash 2.2.4

Do i need to upgrade ?

And also i am going to upgrade in few mins, could you please check if the other input filter and output looks fine?

Once all pieces are set Kibana should auto populate the data right?

---

<div class="post-metadata">

### Author: ![kevivek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kevivek/32/30791_2.png) [@kevivek](https://discuss.elastic.co/u/kevivek)
#### Post date: [May 4, 2018, 3:36pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/8 "2018-05-04T15:36:27Z")

</div>

Upgraded to vivsingh@blr-lvg2e:~$ /usr/share/logstash/bin/logstash --version  
logstash 6.2.4

vivsingh@blr-lvg2e:~$ curl "[http://localhost:9200/\_cat/indices?v](http://localhost:9200/_cat/indices?v)"  
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size  
green open .kibana SjYX9nKTRm2uJ2TumYeM2A 1 0 2 1 10.7kb 10.7kb  
yellow open logstash-2018.05.04 GpnkOrS9SXW\_cxguPIFm4A 5 1 52 0 42.6kb 42.6kb  
yellow open apache OPizXnbOSl6tLrcYW6n6rQ 5 1 0 0 1.1kb 1.1kb

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 1, 2018, 3:36pm UTC](https://discuss.elastic.co/t/not-able-see-data-in-kibana-is-logstash-pushing-to-es/130534/9 "2018-06-01T15:36:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
