# Just one unknown field - Filebeat json parsing

**URL:** <https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [May 28, 2020, 12:25pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738 "2020-05-28T12:25:39Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![vdelcampo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vdelcampo/32/65731_2.png) [@vdelcampo](https://discuss.elastic.co/u/vdelcampo)\
**Post date:** [May 28, 2020, 12:25pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/1 "2020-05-28T12:25:40Z")

</div>

Hi.

Im using filebeat to send to Elasticsearch a preformatted json logfile. The files are parsing fine, but i have an unknown field and i don´t know why:

 ![captura](https://us1.discourse-cdn.com/elastic/original/3X/5/d/5d89f701e0a6de4b726d40ac7c4348b915bc6b8f.png)

Any ideas?

Thanks in advance

Víctor

---

<div class="post-metadata">

**Author:** ![MarianaD](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/marianad/32/42687_2.png) [@MarianaD](https://discuss.elastic.co/u/MarianaD)\
**Post date:** [May 28, 2020, 12:49pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/2 "2020-05-28T12:49:42Z")

</div>

hi @vdelcampo, what is the unknown field in this case? could not pinpoint it from the image.  
Also, can you provide us with the filebeat config /pipelines etc where you process the log.

---

<div class="post-metadata">

**Author:** ![vdelcampo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vdelcampo/32/65731_2.png) [@vdelcampo](https://discuss.elastic.co/u/vdelcampo)\
**Post date:** [May 28, 2020, 1:52pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/3 "2020-05-28T13:52:11Z")

</div>

Hi Mariana.

In Kibana appears _data.proto\_msg.ratMsg.portfolioResp.portfolio_ field as unknown in Available fields. When i have a look in a message it looks like the image i posted. That field has those subfields and also are not availables. My Filebeat config file is:

filebeat.inputs:  
-type: log  
enabled: true  
json.keys\_under\_root: true  
json.add\_error\_key: true  
json.message\_key: log

filebeat.config.modules:  
path: ${path.config}/modules.d/\*.yml  
reload.enabled: false

output.elasticsearch:  
hosts: ["x.x.x.x:9200"]  
index: "rat-%{+yyyy.MM.dd}"

setup.template:  
name: 'rat'  
pattern: 'rat-\*'  
enabled: false

processors:  
drop\_fields:  
fields: ["agent.ephemeral\_id", "agent.hostname", "agent.id", "agent.type", "agent.version", "ecs.version", "input.type", "log.offset", "version", "host.name"]  
setup.ilm.enabled: false

Regards

Víctor

---

<div class="post-metadata">

**Author:** ![vdelcampo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vdelcampo/32/65731_2.png) [@vdelcampo](https://discuss.elastic.co/u/vdelcampo)\
**Post date:** [June 2, 2020, 1:36pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/4 "2020-06-02T13:36:26Z")

</div>

Hi @MarianaD .

Any ideas?

Regards!

---

<div class="post-metadata">

**Author:** ![vdelcampo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vdelcampo/32/65731_2.png) [@vdelcampo](https://discuss.elastic.co/u/vdelcampo)\
**Post date:** [June 4, 2020, 2:00pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/5 "2020-06-04T14:00:46Z")

</div>

Got it, the problem was with json files. That field has . I removed it an it works.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 2, 2020, 2:05pm UTC](https://discuss.elastic.co/t/just-one-unknown-field-filebeat-json-parsing/234738/6 "2020-07-02T14:05:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.