# Codec json is not working

**URL:** <https://discuss.elastic.co/t/codec-json-is-not-working/73637>\
**Category:** Logstash\
**Created:** [February 2, 2017, 6:56am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637 "2017-02-02T06:56:43Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![jmcjmcjmc](https://avatars.discourse-cdn.com/v4/letter/j/5f8ce5/32.png) [@jmcjmcjmc](https://discuss.elastic.co/u/jmcjmcjmc)\
**Post date:** [February 2, 2017, 6:56am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/1 "2017-02-02T06:56:43Z")

</div>

I am trying to read data from Kafka (fed by beats) and send to ES. Using codec =\> "json" does not work at all.

input {  
kafka {  
bootstrap\_servers =\> "10.100.177.100:9999"  
topics =\> ["metricbeats"]  
type =\> "metricbeat"  
codec =\> "json"  
client\_id =\> "metricbeat"  
}  
}

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [February 2, 2017, 7:01am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/2 "2017-02-02T07:01:41Z")

</div>

Could you be more specific than "does not work at all"? What _do_ you get? What's in the Logstash log?

---

<div class="post-metadata">

**Author:** ![jmcjmcjmc](https://avatars.discourse-cdn.com/v4/letter/j/5f8ce5/32.png) [@jmcjmcjmc](https://discuss.elastic.co/u/jmcjmcjmc)\
**Post date:** [February 2, 2017, 7:05am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/3 "2017-02-02T07:05:32Z")

</div>

When I have codec =\> "json", nothing goes to ES. No error in the log. When I comment it out, everything goes to ES. However, the payload is wrapped in a message field.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [February 2, 2017, 7:12am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/4 "2017-02-02T07:12:11Z")

</div>

Sounds like you should use the json\_lines codec instead so that you split on newline characters.

---

<div class="post-metadata">

**Author:** ![jmcjmcjmc](https://avatars.discourse-cdn.com/v4/letter/j/5f8ce5/32.png) [@jmcjmcjmc](https://discuss.elastic.co/u/jmcjmcjmc)\
**Post date:** [February 2, 2017, 7:17am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/5 "2017-02-02T07:17:46Z")

</div>

I quickly gave it a shot. No luck.

In the log, I enabled the debugging.  
[2017-02-02T00:15:32,711][DEBUG][logstash.inputs.kafka] config LogStash::Inputs::Kafka/@bootstrap\_servers = "10.100.177.37:6667"  
[2017-02-02T00:15:32,713][DEBUG][logstash.inputs.kafka] config LogStash::Inputs::Kafka/@topics = ["metricbeats"]  
[2017-02-02T00:15:32,714][DEBUG][logstash.inputs.kafka] config LogStash::Inputs::Kafka/@type = "metricbeat"  
[2017-02-02T00:15:32,714][DEBUG][logstash.inputs.kafka] config LogStash::Inputs::Kafka/@codec = \<LogStash::Codecs::JSONLines id=\>"json\_lines\_39ef8b82-24e9-42ad-989d-a07d64641341", enable\_metric=\>true, charset=\>"UTF-8", delimiter=\>"\n"\>

---

<div class="post-metadata">

**Author:** ![jmcjmcjmc](https://avatars.discourse-cdn.com/v4/letter/j/5f8ce5/32.png) [@jmcjmcjmc](https://discuss.elastic.co/u/jmcjmcjmc)\
**Post date:** [February 2, 2017, 7:36am UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/6 "2017-02-02T07:36:00Z")

</div>

I also enabled the logging at trace level. But there is not much useful information.

loggers = inputkafka,outputelasticsearch,filterjson,codecjson,codecjsonlines  
#kafkaconsumer  
[logger.inputkafka.name](http://logger.inputkafka.name) = logstash.inputs.kafka  
logger.inputkafka.level = trace

[logger.outputelasticsearch.name](http://logger.outputelasticsearch.name) = logstash.outputs.elasticsearch  
logger.outputelasticsearch.level = trace

[logger.filterjson.name](http://logger.filterjson.name) = logstash.filters.json  
logger.filterjson.level = trace

[logger.kafkaconsumer.name](http://logger.kafkaconsumer.name) = org.apache.kafka.clients.consumer  
logger.kafkaconsumer.level = trace

[logger.codecjson.name](http://logger.codecjson.name) = logstash.codecs.json  
logger.codecjson.level = trace

[logger.codecjsonlines.name](http://logger.codecjsonlines.name) = logstash.codecs.jsonlines  
logger.codecjsonlines.level = trace

---

<div class="post-metadata">

**Author:** ![jmcjmcjmc](https://avatars.discourse-cdn.com/v4/letter/j/5f8ce5/32.png) [@jmcjmcjmc](https://discuss.elastic.co/u/jmcjmcjmc)\
**Post date:** [February 2, 2017, 8:00pm UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/7 "2017-02-02T20:00:57Z")

</div>

Any further assistance is appreciated here.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 2, 2017, 8:00pm UTC](https://discuss.elastic.co/t/codec-json-is-not-working/73637/8 "2017-03-02T20:00:56Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.