Is it possible to mix json and plain text?

Elastic Stack Beats
,
1

I use filebeat to grab my Docker logs. Most of these are plain text. However, for self-created services I like to use Serilog for structured logging and it therefore formats the logs in elasticsearch format.

Is it possible to somehow enable json decoding partially, and let non-json logs go through as though json decoding wasn't enabled? Possibly by configuring multiple container inputs and filtering appropriately?

I already tried enabling json decoding, but then all non-json logs will result in an elasticsearch error, which ironically also fails as the log message is a cropped json body.

2

Hi @Mikael_Elkiaer,

would adding some conditions as depicted here:
https://www.elastic.co/guide/en/beats/filebeat/current/defining-processors.html

for the json processor help?
you could conditionally apply the json decoding based on the fetched fields.

3

That's what I was hoping you could tell me.
How would I add such a processor so that it would send the message as is if it is plain text, or decode the message if it is json?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.