Pipeline creation with multiple fields

Hi,
I have created a pipeline for NER with a single "field_map", but I want a pipeline which can process multiple fields. Is that possible in the real case scenario?
PUT _ingest/pipeline/ner
{
"description": "NER pipeline",
"processors": [
{
"inference": {
"model_id": "elastic__distilbert-base-uncased-finetuned-conll03-english",
"target_field": "ml.ner",
"field_map": {
"paragraph": "text_field"
}
}
},
{
"script": {
"lang": "painless",
"if": "return ctx['ml']['ner'].containsKey('entities')",
"source": "Map tags = new HashMap(); for (item in ctx['ml']['ner']['entities']) { if (!tags.containsKey(item.class_name)) tags[item.class_name] = new HashSet(); tags[item.class_name].add(item.entity);} ctx['tags'] = tags;"
}
}
],
"on_failure": [
{
"set": {
"description": "Index document to 'failed-'",
"field": "_index",
"value": "failed-{{{ _index }}}"
}
},
{
"set": {
"description": "Set error message",
"field": "ingest.failure",
"value": "{{_ingest.on_failure_message}}"
}
}
]
}

For the above pipeline creation, instead of paragraph, I also want to pass "Description" and "Title" fields.
Is it possible in the real case scenario? Please help me on this.

Hello @Manasa4,

It is possible. You can add other inference processors, but now for the "Description" and "Title" fields.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.