I'm still trying to understand and made some progress:
- Cluster is setup from scratch; all is fine
- If adding all my pipelines, then restarting elasticsearch I'm back to the error:
java.lang.IllegalArgumentException: pipeline with id [xpack_monitoring_2] does not exist
but yet it's there:
curl -XGET 'localhost:9200/_ingest/pipeline/xpack_monitoring_2?pretty'
{
"xpack_monitoring_2" : {
"description" : "2: This is a placeholder pipeline for Monitoring API version 2 so that future versions may fix breaking changes.",
"processors" :
}
}
So: I've started to add my pipelines one by one and found that the error starts as soon as I'm adding a pipeline with a painless-script. Adding the pipeline with the painless-script renders all my pipelines unusable after a restart of the Elasticsearch server ingest node until I delete and re-add all pipelines to the running Elasticsearch server.
I'll try to simplify my setup to then post a sample script & pipeline here.
Additionally this might be related to these topics: