Ignore failures while performing _reindex


(Tobias Sette) #1

I just want to create a new index in order to apply this pipeline:

PUT _ingest/pipeline/foobar
{
"description": "Converts foobar data into json",
"processors": [
{
"gsub": {
"field": "message",
"pattern": """[foobar] """,
"replacement": "",
"ignore_missing": true,
"ignore_failure": true,
"on_failure" : [
{
"set" : {
"field" : "error",
"value" : "{{ _ingest.on_failure_message }}"
}
}
]
}
},
{
"json" : {
"field" : "message",
"target_field" : "foobar_data",
"ignore_failure": true,
"on_failure" : [
{
"set" : {
"field" : "error",
"value" : "{{ _ingest.on_failure_message }}"
}
}
]
}
}
]
}

Continuing the discussion from Skip mapper_parsing_exception on remote reindex: