Unable to export logs from AKS cluster to kibana for specific pods

Elastic Stack Beats
1

We are using filebeat.yaml configuration(which is similar to beats/filebeat-daemonset.yaml at master · elastic/beats · GitHub) to migrate or export all the logs from AKS cluster to Kibana and till date everything works fine for React, Node, Python and .NET Core applications.
We have recently started using Lenses SQL processor, which is gives us the logs in AKS cluster but this logs are not getting exported to Kibana.

Is there any configuration which enables/disables few kind of pod logs to be not exported into kibana?

2

Did you try to use a separate index for this log? I think the problem is with the log parsing

3

I'm assuming by index, you meant creating new index pattern in Kibana cluster.

We couldn't find the matching index pattern, while defining the index pattern.

This pod of SQL Processor would be a deployment pod created at runtime by Lenses, the deployment pod name would be a GUID, something like shown below

image
image1118×310 36.1 KB

4

You may have to built one using Grok and enrichment technic.
However, you have to confirm the pod is reachable to your sensor and interface by doing traffic capture

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.