# A panic of dumplicated kafka output **URL:** \ **Category:** Beats\ **Tags:** filebeat\ **Created:** [August 9, 2018, 7:53am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645 "2018-08-09T07:53:30Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![yuz11](https://avatars.discourse-cdn.com/v4/letter/y/7ba0ec/32.png) [@yuz11](https://discuss.elastic.co/u/yuz11)\ **Post date:** [August 9, 2018, 7:53am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/1 "2018-08-09T07:53:30Z")
I get this panic as below,it happens when my filebeat kafka output module is reconnecting the kafka server as the Cloud server of kafka connection is not stable or server is restarted(cloud service,out of our control.Sad!): panic: output type 'kafka' exists already goroutine 5 [running]: [github.com/elastic/beats/libbeat/outputs.RegisterType](http://github.com/elastic/beats/libbeat/outputs.RegisterType)(0xe8c100, 0x5, 0xecf2e8) e:/work\_space/Go/src/github.com/elastic/beats/libbeat/outputs/output\_reg.go:30 +0x170 [github.com/elastic/beats/libbeat/outputs/kafka.init.0.func1()](http://github.com/elastic/beats/libbeat/outputs/kafka.init.0.func1()) e:/work\_space/Go/src/github.com/elastic/beats/libbeat/outputs/kafka/kafka.go:118 +0x11d created by [github.com/elastic/beats/libbeat/outputs/kafka.init.0](http://github.com/elastic/beats/libbeat/outputs/kafka.init.0) e:/work\_space/Go/src/github.com/elastic/beats/libbeat/outputs/kafka/kafka.go:109 +0x170 I check the code and found the method func RegisterType(name string, f Factory) { if outputReg[name] != nil { panic(fmt.Errorf("output type '%v' exists already", name)) } outputReg[name] = f } I found that really strange after this panic happened,the filebeat still get one connection with the kafka server.But It's not working anymore. No message is sent since then. I use tcp-drop kill this connection,however,it will reconnect and resume service(message will be able to send again) It happens time to time,any suggestion? ---
**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\ **Post date:** [August 10, 2018, 6:23am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/2 "2018-08-10T06:23:46Z")
What version of Filebeat are you using? Could you open a Github issue with this? If we get a panic it sounds a lot like a bug. ---
**Author:** ![yuz11](https://avatars.discourse-cdn.com/v4/letter/y/7ba0ec/32.png) [@yuz11](https://discuss.elastic.co/u/yuz11)\ **Post date:** [August 10, 2018, 8:59am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/3 "2018-08-10T08:59:08Z")
I build it myself. Git version as below SHA-1: 6fe02a4dfc2de58490270a15affaa0aec0f5f8df I may find a problem may lead to my issue... it's in the kafka lib sarama/broker.go It does not set a readtimeout duraling SASL handshake. I may block in the io.ReadFull,waiting for response. ---
**Author:** ![yuz11](https://avatars.discourse-cdn.com/v4/letter/y/7ba0ec/32.png) [@yuz11](https://discuss.elastic.co/u/yuz11)\ **Post date:** [August 10, 2018, 9:08am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/4 "2018-08-10T09:08:46Z")
yeah,I assume the problem is solve after I set the timeout, I get the SASL auth timeout error instead of block in the waiting. 2018-08-10T17:02:57.876+0800 INFO kafka/log.go:36 Failed to read response while authenticating with SASL to broker [[xxx:xxx read tcp xxx:xxx-\>xxx:xxx: i/o timeout]]: %!s(MISSING) ---
**Author:** ![yuz11](https://avatars.discourse-cdn.com/v4/letter/y/7ba0ec/32.png) [@yuz11](https://discuss.elastic.co/u/yuz11)\ **Post date:** [August 10, 2018, 9:09am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/5 "2018-08-10T09:09:19Z")
but still u guys should check for the panic thing ---
**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\ **Post date:** [August 10, 2018, 11:50am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/6 "2018-08-10T11:50:54Z")
The stack trace makes no sense to me. I checked out said commit, but Line 109 is empty and line 118 is a function definition, but no call. The stack-trace also indicates that the second call `func1` is using a closure. We don't use a closure in the init function. Have you made any modifications to kafka.go? In go `init` is called before the beat actually starts up. The init function for each package is run exactly once. Unless you have a second output or modified the init function to register the output 'lazily' or whatever, then this panic can not occur. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 7, 2018, 11:50am UTC](https://discuss.elastic.co/t/a-panic-of-dumplicated-kafka-output/143645/7 "2018-09-07T11:50:55Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.