Logstash Data Enhancement


(Satya Sandeep) #1

I have a kafka -ES pipeline running , i want to add new fields basing on a certain field e.g
i have the following parameters from kafka:
{
"id":1,
"name":"name1"}
now depending on the id i want to add department to the same pipeline i have a 100 id's previously I had done manually by If filter where in i check id manually ,
I want to know a better way to do lookup from a file and enhance data.
CSV Sample:
1,"sales"
2,"reception" e.t.c


#2

The translate filter will do that.


(Satya Sandeep) #3

translate filter as far as my knowledge will replace it but i need an extra field along with existing fields


#4

translate will add a field, by default called translation, or whatever you want if you use the destination option.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.