Logstash: Reading a file inside filter/input/output


(Krushnat Khawale) #1

I am uploading data from a CSV file and here is Use case.
for a column, user can enter description, and I want to group the records in several categories based on description
for that I want to add one more column/field into elastic search. As no of fields to validate can vary, I have a csv file to validate it.
So is it possible to read a file inside filter/input/output. Other solution will also be fine.


(Mark Walkom) #2

So it's a dynamic CSV file?


(Krushnat Khawale) #3

Yes, the file against which, is to be validated may change.
Hence I need to either read the file in filter or I want to make a REST call which will accept description and will return required category.


(Mark Walkom) #4

Logstash currently isn't that dynamic, so I don't believe you will be able to use it for this.


(Krushnat Khawale) #5

Okay,
Would you like to suggest a solution for this?

Thanks for your time.


(Mark Walkom) #6

No idea, sorry.


(Guy Boertje) #7

Have a look at the translate filter


(system) #8