JSON Filter fails on valid key names

Elastic Stack Logstash
1

I have some Kafka messages that have key names that contain reserved Logstash characters -- specifically '[" and "]". Additionally the json document also has arrays.

My Logstash pipeline is generating:

[WARN ][logstash.filters.json ][unilog] Exception caught in json filter {:exception=>"Invalid FieldReference: custom_news[0][code]"

I would attempt to change the key names by treating the entire document as a string first and then using the JSON Filter, but with the "[" and "]" characters ALSO designating arrays in the document that is quite cumbersome and seems should be unnecessary as the key names are indeed valid for json documents.

Any help/insight as to how I can resolve this without a ton of coding would be appreciated.

Thanks.

2

This is an open issue.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.