Kibana does not log all lines as json

Elastic Stack Kibana
1

I have Kibana deployed as an ECK resource.

Despite the following config:

config:
  logging:
    appenders:
      json-layout:
        type: console
        layout:
          type: json
    root:
      appenders: [json-layout]

I still get large blocks of output on stdout which look like this:

=== Debug: GET /internal/apm/observability_overview (10ms) ===
get_has_aggregated_transactions
GET metrics-apm*,apm-*/_search
{
  "track_total_hits": 1,
  "terminate_after": 1,
  "size": 0,
  "query": {
    "bool": {
      "filter": [
        {
          "exists": {
            "field": "transaction.duration.histogram"
          }
        },
        {
          "range": {
            "@timestamp": {
              "gte": 1676470456959,
              "lte": 1676471356959,
              "format": "epoch_millis"
            }
          }
        },
        {
          "terms": {
            "processor.event": [
              "metric"
            ]
          }
        }
      ]
    }
  }
}

How do I instruct Kibana to log these details as ndjson, like the rest of its logs are formatted?

At startup, kibana does logs as ndjson, so these blocks are incredibly noisy and annoying when trying to ingest the logs:

{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.4.0"},"@timestamp":"2023-02-15T14:20:04.101+00:00","message":"Kibana process configured with roles: [background_tasks, ui]","log":{"level":"INFO","logger":"node"},"process":{"pid":7},"trace":{"id":"651be26645ffa6f703115a30aa18991e"},"transaction":{"id":"40f3d9ec5b0b8337"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.4.0"},"@timestamp":"2023-02-15T14:20:27.745+00:00","message":"Plugin \"cloudChat\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":7},"trace":{"id":"651be26645ffa6f703115a30aa18991e"},"transaction":{"id":"40f3d9ec5b0b8337"}}
{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.4.0"},"@timestamp":"2023-02-15T14:20:27.746+00:00","message":"Plugin \"cloudExperiments\" is disabled.","log":{"level":"INFO","logger":"plugins-service"},"process":{"pid":7},"trace":{"id":"651be26645ffa6f703115a30aa18991e"},"transaction":{"id":"40f3d9ec5b0b8337"}}
...
1 Like
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.