I have a Logstash pipeline pipeline running in kubernetes. I am collecting all logs from the Kubernetes cluster using filebeat with activated hit based autodiscover. I would like to force filebeat to use a specific ingest pipeline for my Logstash pipeline logs.
In order to achieve this I have annotated my Logstash Pod with:
I got it working. The precondition is that the ingest pipeline used by the module is existing and (if Logstash is used to ingest to elastic) it considers the pipeline_id in the output.
Now I am able to annotate my workloads with
podAnnotations:
co.elastic.logs/module: logstash
and it works.
However now I am trying to annotate my workload with a custom pipeline and it seems not to have any effect at all:
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.