# Logstash 2.2.x kafka output large increase in broker tcp connections

**URL:** <https://discuss.elastic.co/t/logstash-2-2-x-kafka-output-large-increase-in-broker-tcp-connections/43270>\
**Category:** Logstash\
**Created:** [March 2, 2016, 4:23pm UTC](https://discuss.elastic.co/t/logstash-2-2-x-kafka-output-large-increase-in-broker-tcp-connections/43270 "2016-03-02T16:23:20Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![toma](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/toma/32/8215_2.png) [@toma](https://discuss.elastic.co/u/toma)\
**Post date:** [March 2, 2016, 4:23pm UTC](https://discuss.elastic.co/t/logstash-2-2-x-kafka-output-large-increase-in-broker-tcp-connections/43270/1 "2016-03-02T16:23:20Z")

</div>

Upgrading from logstash 2.1.1 to 2.2.2 and seeing a rough 10x increase in established tcp connections to brokers. Running in a large environment this is a problem. We want to use ls 2.2.x to take advantage of the better handling of 503s with elasticsearch output.

Testing env:

- ubuntu trusty - oracle java 1.7.0\_51 - logstash 2.2.2
- one kafka output to one topic with 36 partitions on 6 brokers
- config using bootstrap\_servers, topic\_id & compression\_type = snappy
- after a few mins logstash has 72 established tcp connections to kafka brokers

Same config with logstash 2.1.1 maintain ~15 tcp connections  
Setting "message\_key" to multiple test strings (not starting with digit) had not effect.  
Noticeable change between ls 2.1.1 & 2.2.2 is upgrade from jruby-kafka 1.4.0 to 1.5.0

---

<div class="post-metadata">

**Author:** ![Joe\_Lawson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joe_lawson/32/3390_2.png) [@Joe\_Lawson](https://discuss.elastic.co/u/Joe_Lawson)\
**Post date:** [March 3, 2016, 5:38pm UTC](https://discuss.elastic.co/t/logstash-2-2-x-kafka-output-large-increase-in-broker-tcp-connections/43270/2 "2016-03-03T17:38:51Z")

</div>

I would imagine this has something to do with the pipeline changes in 2.2  
check out  
[https://www.elastic.co/guide/en/logstash/current/upgrading-logstash-2.2.html](https://www.elastic.co/guide/en/logstash/current/upgrading-logstash-2.2.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:08am UTC](https://discuss.elastic.co/t/logstash-2-2-x-kafka-output-large-increase-in-broker-tcp-connections/43270/3 "2017-07-06T05:08:27Z")

</div>