# Change log level Logstash kafka input plugin?

**URL:** <https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426>\
**Category:** Logstash\
**Created:** [January 9, 2020, 12:18pm UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426 "2020-01-09T12:18:35Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![SKumarMN](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/skumarmn/32/27537_2.png) [@SKumarMN](https://discuss.elastic.co/u/SKumarMN)\
**Post date:** [January 9, 2020, 12:18pm UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426/1 "2020-01-09T12:18:35Z")

</div>

I am using kafka input plugin and logs are getting filled with the below msgs

> [2020-01-09T17:28:16,750][WARN][org.apache.kafka.clients.NetworkClient] [Consumer clientId=logstash-0, groupId=logstash] Error while fetching metadata with correlation id 1667 : {devglan-log-test1=UNKNOWN\_TOPIC\_OR\_PARTITION}  
> [2020-01-09T17:28:16,854][WARN][org.apache.kafka.clients.NetworkClient] [Consumer clientId=logstash-0, groupId=logstash] Error while fetching metadata with correlation id 1668 : {devglan-log-test1=UNKNOWN\_TOPIC\_OR\_PARTITION}

I tried to set the log level of kaka input plugin to ERROR as below

> logger.kafkainput.name = logstash.inputs.kafka
> 
> logger.kafkainput.level = error

but it didnt help.

> (base) C02VN29BHTD8:bin apple$ curl -XGET 'localhost:9600/\_node/logging?pretty'  
> {  
> "host" : "C02VN29BHTD8",  
> "version" : "6.2.4",  
> "http\_address" : "127.0.0.1:9600",  
> "id" : "90f1ffa9-bf26-43a9-8b97-1f6edefbc41e",  
> "name" : "C02VN29BHTD8",  
> "loggers" : {  
> "logstash.agent" : "INFO",  
> "logstash.api.service" : "INFO",  
> "logstash.codecs.plain" : "INFO",  
> "logstash.codecs.rubydebug" : "INFO",  
> "logstash.config.source.local.configpathloader" : "INFO",  
> "logstash.config.source.multilocal" : "INFO",  
> "logstash.config.sourceloader" : "INFO",  
> "logstash.inputs.kafka" : "ERROR",  
> "logstash.instrument.periodicpoller.deadletterqueue" : "INFO",  
> "logstash.instrument.periodicpoller.jvm" : "INFO",  
> "logstash.instrument.periodicpoller.os" : "INFO",  
> "logstash.instrument.periodicpoller.persistentqueue" : "INFO",  
> "logstash.modules.scaffold" : "INFO",  
> "logstash.outputs.stdout" : "INFO",  
> "logstash.pipeline" : "INFO",  
> "logstash.plugins.registry" : "INFO",  
> "logstash.runner" : "INFO",  
> "org.apache.kafka.clients.ClientUtils" : "INFO",  
> "org.apache.kafka.clients.CommonClientConfigs" : "INFO",  
> "org.apache.kafka.clients.Metadata" : "INFO",  
> "org.apache.kafka.clients.NetworkClient" : "INFO",  
> "org.apache.kafka.clients.consumer.ConsumerConfig" : "INFO",  
> "org.apache.kafka.clients.consumer.KafkaConsumer" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.AbstractCoordinator" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.AbstractPartitionAssignor" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.ConsumerCoordinator" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient" : "INFO",  
> "org.apache.kafka.clients.consumer.internals.Fetcher" : "INFO",  
> "org.apache.kafka.common.metrics.JmxReporter" : "INFO",  
> "org.apache.kafka.common.metrics.Metrics" : "INFO",  
> "org.apache.kafka.common.network.NetworkReceive" : "INFO",  
> "org.apache.kafka.common.network.PlaintextChannelBuilder" : "INFO",  
> "org.apache.kafka.common.network.Selector" : "INFO",  
> "org.apache.kafka.common.protocol.Errors" : "INFO",  
> "org.apache.kafka.common.requests.DeleteAclsResponse" : "INFO",  
> "org.apache.kafka.common.utils.AppInfoParser" : "INFO",  
> "org.apache.kafka.common.utils.Utils" : "INFO",  
> "org.logstash.Logstash" : "INFO",  
> "org.logstash.common.DeadLetterQueueFactory" : "INFO",  
> "org.logstash.common.io.DeadLetterQueueWriter" : "INFO",  
> "org.logstash.config.ir.CompiledPipeline" : "INFO",  
> "org.logstash.instrument.metrics.gauge.LazyDelegatingGauge" : "INFO",  
> "org.logstash.secret.store.SecretStoreFactory" : "INFO",  
> "slowlog.logstash.codecs.plain" : "TRACE",  
> "slowlog.logstash.codecs.rubydebug" : "TRACE",  
> "slowlog.logstash.inputs.kafka" : "TRACE",  
> "slowlog.logstash.outputs.stdout" : "TRACE"  
> }  
> }

Unless i set the level of "org.apache.kafka.clients.NetworkClient" to "ERROR" it doesn't work.

My question is how to change the log level of org.apache.kafka.clients.NetworkClient in log4j.properties

---

<div class="post-metadata">

**Author:** ![SKumarMN](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/skumarmn/32/27537_2.png) [@SKumarMN](https://discuss.elastic.co/u/SKumarMN)\
**Post date:** [January 9, 2020, 12:20pm UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426/2 "2020-01-09T12:20:25Z")

</div>

Note I can change the logger level of the module org.apache.kafka.clients.NetworkClient to error using the rest API as below.

> curl -XPUT 'localhost:9600/\_node/logging?pretty' -H 'Content-Type: application/json' -d'{"logger.org.apache.kafka.clients.NetworkClient" : "ERROR"}'

However I need to make it persistent hence need to have the setting in log4j.properties

---

<div class="post-metadata">

**Author:** ![Marquita](https://avatars.discourse-cdn.com/v4/letter/m/87869e/32.png) [@Marquita](https://discuss.elastic.co/u/Marquita)\
**Post date:** [January 28, 2020, 4:36am UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426/3 "2020-01-28T04:36:46Z")

</div>

In this article, we continue our journey into the rich world of Logstash input plugins focusing on the Beats family (e.g., Filebeat and Metricbeat), various file and system input plugins, network, email, and chat protocols, cloud platforms, web applications, and message brokers/platforms.

---

<div class="post-metadata">

**Author:** ![Marquita](https://avatars.discourse-cdn.com/v4/letter/m/87869e/32.png) [@Marquita](https://discuss.elastic.co/u/Marquita)\
**Post date:** [January 30, 2020, 4:25am UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426/4 "2020-01-30T04:25:06Z")

</div>

any one have other information? [UPSers](https://www.upsers.club/)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 27, 2020, 4:25am UTC](https://discuss.elastic.co/t/change-log-level-logstash-kafka-input-plugin/214426/5 "2020-02-27T04:25:08Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
