Any logs to monitor ingest pipelines ? (Fleet + Custom Log Integration + Custom configurations)

[mehdi-lamrani]

8.7 here

I've configured a basic pipeline for fleet and elastic-agent using custom configuration (see below)

when the pipeline fails documents are not inserted in the data stream.
How to get some logs about how did the pipeline go (well or bad) ?

(Actually I have the same question for the processors as well).

Basically, I am blindfold and I am left guessing and it is really discomforting

Cheers;

[warkolm (Mark Walkom)]

You will need to add a fail processor to log something. Ingest pipelines | Elasticsearch Guide [8.7] | Elastic goes into that some more.