# Kibana with Logstash 5.0 elasticsearch 5.0 error

**URL:** <https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261>\
**Category:** Logstash\
**Created:** [November 7, 2016, 7:04pm UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261 "2016-11-07T19:04:08Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![azteam](https://avatars.discourse-cdn.com/v4/letter/a/b5ac83/32.png) [@azteam](https://discuss.elastic.co/u/azteam)\
**Post date:** [November 7, 2016, 7:04pm UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/1 "2016-11-07T19:04:08Z")

</div>

## I setup ELK on Ubuntu 15. So I have some problems. Logs logstash returns:

[2016-11-08T02:00:02,607][WARN][logstash.outputs.elasticsearch] UNEXPECTED POOL ERROR {:e=\>#\<LogStash::Outputs::ElasticSearch::HttpClient::Pool::NoConnectionAvailableError: No Available connections\>}  
[2016-11-08T02:00:02,607][ERROR][logstash.outputs.elasticsearch] Attempted to send a bulk request to elasticsearch, but no there are no living connections in the connection pool. Perhaps Elasticsearch is unreachable or down? {:error\_message=\>"No Available connections", :class=\>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::NoConnectionAvailableError", :will\_retry\_in\_seconds=\>64}

## Logs filebeat:

2016-11-08T01:58:27+07:00 ERR Connecting error publishing events (retrying): read tcp xxxx:63855-\>logforwarder-server:5044: i/o timeout  
2016-11-08T01:58:32+07:00 INFO Non-zero metrics in the last 30s: libbeat.logstash.publish.read\_errors=1

Config logstash:

input {  
beats {  
port =\> 5044  
ssl =\> true  
ssl\_certificate =\> "/etc/pki/tls/certs/logstash-forwarder.crt"  
ssl\_key =\> "/etc/pki/tls/private/logstash-forwarder.key"  
}  
}

## output { elasticsearch { hosts =\> ["localhost:9200"] sniffing =\> true manage\_template =\> false index =\> "%{[@metadata][beat]}-%{+YYYY.MM.dd}" document\_type =\> "%{[@metadata][type]}" } }

## tcp 0 0 0.0.0.0:9200 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:80 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:5044 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:9300 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:22 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:443 0.0.0.0:\* LISTEN tcp 0 0 127.0.0.1:9600 0.0.0.0:\* LISTEN tcp 0 0 0.0.0.0:5601 0.0.0.0:\* LISTEN

How to I solve my problems?

Thanks.

---

<div class="post-metadata">

**Author:** ![w0lverine](https://avatars.discourse-cdn.com/v4/letter/w/90db22/32.png) [@w0lverine](https://discuss.elastic.co/u/w0lverine)\
**Post date:** [November 8, 2016, 2:01am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/2 "2016-11-08T02:01:40Z")

</div>

can you query elasticsearch?

> ps aux | grep elastic

Also, if you can provide the log as well.

---

<div class="post-metadata">

**Author:** ![azteam](https://avatars.discourse-cdn.com/v4/letter/a/b5ac83/32.png) [@azteam](https://discuss.elastic.co/u/azteam)\
**Post date:** [November 8, 2016, 2:12am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/3 "2016-11-08T02:12:24Z")

</div>

> [@w0lverine](#):
>
> ps aux | grep elastic

Hi w0lverine,  
#ps aux | grep elasticsearch  
elastic+ 1361 0.7 41.5 5837196 2537096 ? Ssl 01:32 3:36 /usr/bin/java -Xms2g -Xmx2g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+AlwaysPreTouch -server -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Dlog4j.skipJansi=true -XX:+HeapDumpOnOutOfMemoryError -Des.path.home=/usr/share/elasticsearch -cp /usr/share/elasticsearch/lib/elasticsearch-5.0.0.jar:/usr/share/elasticsearch/lib/\* org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch/elasticsearch.pid --quiet -Edefault.path.logs=/var/log/elasticsearch -Edefault.path.data=/var/lib/elasticsearch -Edefault.path.conf=/etc/elasticsearch

* * *

## Logs elasticsearch

[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [aggs-matrix-stats]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [ingest-common]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [lang-expression]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [lang-groovy]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [lang-mustache]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [lang-painless]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [percolator]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [reindex]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [transport-netty3]  
[2016-11-08T01:28:56,224][INFO][o.e.p.PluginsService] [GxcaZpM] loaded module [transport-netty4]  
[2016-11-08T01:28:56,225][INFO][o.e.p.PluginsService] [GxcaZpM] no plugins loaded  
[2016-11-08T01:28:59,072][INFO][o.e.n.Node] [GxcaZpM] initialized  
[2016-11-08T01:28:59,073][INFO][o.e.n.Node] [GxcaZpM] starting ...  
[2016-11-08T01:28:59,370][INFO][o.e.t.TransportService] [GxcaZpM] publish\_address {ELK-IP-PUBLIC:9300}, bound\_addresses {0.0.0.0:9300}  
[2016-11-08T01:28:59,374][INFO][o.e.b.BootstrapCheck] [GxcaZpM] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks  
[2016-11-08T01:29:02,461][INFO][o.e.c.s.ClusterService] [GxcaZpM] new\_master {GxcaZpM}{GxcaZpMyS7Gbi3eIC1RbAA}{oMlBSsTwTFiDnRb7Y2I9Fw}{ELK-IP-PUBLIC}{ELK-IP-PUBLIC:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)  
[2016-11-08T01:29:02,487][INFO][o.e.h.HttpServer] [GxcaZpM] publish\_address {ELK-IP-PUBLIC:9200}, bound\_addresses {0.0.0.0:9200}  
[2016-11-08T01:29:02,487][INFO][o.e.n.Node] [GxcaZpM] started  
[2016-11-08T01:29:03,088][INFO][o.e.g.GatewayService] [GxcaZpM] recovered [6] indices into cluster\_state  
[2016-11-08T01:29:05,626][INFO][o.e.c.r.a.AllocationService] [GxcaZpM] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[.kibana][0]] ...]).  
[2016-11-08T01:31:12,626][INFO][o.e.n.Node] [GxcaZpM] stopping ...  
[2016-11-08T01:31:12,715][INFO][o.e.n.Node] [GxcaZpM] stopped  
[2016-11-08T01:31:12,715][INFO][o.e.n.Node] [GxcaZpM] closing ...  
[2016-11-08T01:31:12,727][INFO][o.e.n.Node] [GxcaZpM] closed  
[2016-11-08T01:31:14,061][INFO][o.e.n.Node] initializing ...  
[2016-11-08T01:31:14,162][INFO][o.e.e.NodeEnvironment] [GxcaZpM] using [1] data paths, mounts [[/ (/dev/mapper/ubuntu--vg-root)]], net usable\_space [32.6gb], net total\_space [37gb], spins? [possibly], types [ext4]  
[2016-11-08T01:31:14,162][INFO][o.e.e.NodeEnvironment] [GxcaZpM] heap size [1.9gb], compressed ordinary object pointers [true]  
[2016-11-08T01:31:14,194][INFO][o.e.n.Node] [GxcaZpM] node name [GxcaZpM] derived from node ID; set [node.name] to override  
[2016-11-08T01:31:14,197][INFO][o.e.n.Node] [GxcaZpM] version[5.0.0], pid[1220], build[253032b/2016-10-26T05:11:34.737Z], OS[Linux/3.19.0-15-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0\_111/25.111-b14]

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [November 10, 2016, 6:36am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/4 "2016-11-10T06:36:05Z")

</div>

I think the problem is that your ES server advertises itself as 1.2.3.4:9200 but you've added localhost:9200 to the connection pool. With sniffing enabled Logstash will ask the ES cluster about which nodes are available, and since there's no localhost:9200 node in the cluster Logstash will remove it from the connection pool.

So, either disable sniffing or list the non-loopback address to the ES server.

---

<div class="post-metadata">

**Author:** ![azteam](https://avatars.discourse-cdn.com/v4/letter/a/b5ac83/32.png) [@azteam](https://discuss.elastic.co/u/azteam)\
**Post date:** [November 10, 2016, 7:11am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/5 "2016-11-10T07:11:39Z")

</div>

> [@magnusbaeck](#):
>
> I think the problem is that your ES server advertises itself as 1.2.3.4:9200 but you've added localhost:9200 to the connection pool. With sniffing enabled Logstash will ask the ES cluster about which nodes are available, and since there's no localhost:9200 node in the cluster Logstash will remove it from the connection pool.
> 
> So, either disable sniffing or list the non-loopback address to the ES server.

Hi magnusbaeck,

My config in ES server not only config for local but also I config for all network:  
network.host: 0.0.0.0

# 

# Set a custom port for HTTP:

# 

http.port: 9200

This problem only with ELK 5.0, other versions work ok.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [November 10, 2016, 8:14am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/6 "2016-11-10T08:14:31Z")

</div>

Never mind elasticsearch.yml, I'm talking about your Logstash configuration. Disable sniffing or use name-of-host:9200 instead of localhost:9200.

---

<div class="post-metadata">

**Author:** ![azteam](https://avatars.discourse-cdn.com/v4/letter/a/b5ac83/32.png) [@azteam](https://discuss.elastic.co/u/azteam)\
**Post date:** [November 10, 2016, 8:39am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/7 "2016-11-10T08:39:49Z")

</div>

Hi magnusbaeck,

Do not work if I use name-of-host:9200 but work ok when I disable sniffing.

Thanks,

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 8, 2016, 8:39am UTC](https://discuss.elastic.co/t/kibana-with-logstash-5-0-elasticsearch-5-0-error/65261/8 "2016-12-08T08:39:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
