Pipeline creation with multiple fields

Elastic Search
,
1

Hi,
I have created a pipeline for NER with a single "field_map", but I want a pipeline which can process multiple fields. Is that possible in the real case scenario?
PUT _ingest/pipeline/ner
{
"description": "NER pipeline",
"processors": [
{
"inference": {
"model_id": "elastic__distilbert-base-uncased-finetuned-conll03-english",
"target_field": "ml.ner",
"field_map": {
"paragraph": "text_field"
}
}
},
{
"script": {
"lang": "painless",
"if": "return ctx['ml']['ner'].containsKey('entities')",
"source": "Map tags = new HashMap(); for (item in ctx['ml']['ner']['entities']) { if (!tags.containsKey(item.class_name)) tags[item.class_name] = new HashSet(); tags[item.class_name].add(item.entity);} ctx['tags'] = tags;"
}
}
],
"on_failure": [
{
"set": {
"description": "Index document to 'failed-'",
"field": "_index",
"value": "failed-{{{ _index }}}"
}
},
{
"set": {
"description": "Set error message",
"field": "ingest.failure",
"value": "{{_ingest.on_failure_message}}"
}
}
]
}

For the above pipeline creation, instead of paragraph, I also want to pass "Description" and "Title" fields.
Is it possible in the real case scenario? Please help me on this.

2

Hello @Manasa4,

It is possible. You can add other inference processors, but now for the "Description" and "Title" fields.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.