Ingest nodes and metadata

Elastic Stack Elasticsearch
1

I am trying to use the Ingest Node to transform metadata using the Reindex API. I want to copy metadata to a member field. My pipeline looks like

PUT _ingest/pipeline/p1 
{ 
"processors" : [ { 
        "set" : { 
               "field": "myversion", 
                "value": "{{_source._ingest.version }}" 
    } } 
 ] }

When I run it as
POST _reindex
{
"source": {
"index": "twitter"
},
"dest": {
"index": "twitter_dest",
"pipeline":"p1"
}
}

The version data is not copied into 'myversion'. Any ideas on what is wrong?

2

I don't know ingest particularly well but whatever works in a regular index request ought to work in a reindex request. We have tests for some ingest/reindex combinations but I don't think we have this one.

3

Thanks for your answer

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.