Hi
I have a kibana custom resource with CEL integration like this:
apiVersion: kibana.k8s.elastic.co/v1
kind: Kibana
metadata:
name: kibana
namespace: kibana
spec:
version: 8.13.2
...
config:
...
xpack.fleet.agentPolicies:
...
- name: CEL policy
id: eck-agent
namespace: kibana
....
package_policies:
- name: cel-loki-policy
id: cel-loki-policy
package:
name: cel
namespace: kibana
inputs:
- type: cel
streams:
- enabled: true
data_stream:
type: logs
dataset: "cel.cel"
vars:
- name: "data_stream.dataset"
value: "cel.loki-stream"
- name: "resource_url"
value: "http://loki-gateway:80/loki/api/v1/query_range"
- name: "state"
value: |
{ "some state" }
- name: "program"
value: |
// some cel code
- name: "resource_timeout"
value: "5m"
Everything works fine. But if there is a heavy request that couldn't be completed in 30 seconds, Client.Timeout
errors occur:
{
"log.level": "error",
"@timestamp": "2024-04-18T21:05:46.292+0200",
"message": "request failed",
"component": {
"binary": "filebeat",
"dataset": "elastic_agent.filebeat",
"id": "cel-default",
"type": "cel"
},
"log": {
"source": "cel-default"
},
"log.origin": {
"file.line": 553,
"file.name": "go-retryablehttp@v0.6.6/client.go",
"function": "github.com/hashicorp/go-retryablehttp.(*Client).Do"
},
"ecs.version": "1.6.0",
"log.logger": "input.cel.retryablehttp",
"input_url": "http://loki-gateway:80/loki/api/v1/query_range",
"error": {
"message": "Get \"http://loki-gateway:80/loki/api/v1/query_range?direction=forward&limit=2&query=_REDUCTED_QUERY_&start=1712582033740144385\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
},
"url": "http://loki-gateway:80/loki/api/v1/query_range?direction=forward&limit=2&query=_REDUCTED_QUERY_&start=1712582033740144385",
"service.name": "filebeat",
"id": "cel-cel.cel-cel-loki-stream",
"input_source": "http://loki-gateway:80/loki/api/v1/query_range",
"method": "GET"
}
Is this the bug or the configuration error?
....
vars:
...
- name: "resource_timeout"
value: "5m"