Hi Badger,
Thank you for the quick response.
Do we need to have two separate input file for csv1. I am stuck in creating the file with json input with id as you mentioned above.
And also please suggest if we can use mutate filter for any kind of conversion in this.
Could you please provide the sample config for this scenario if any.
#csv1-> "/opt/parquet/test-input1.csv"
#csv2->"/opt/parquet/test-input2.csv"
input {
file {
type => "file2"
path => "/opt/parquet/test-input2.csv"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}
filter {
if [type] == "file2" {
csv {
columns => ["...."id"...."]
separator => ","
}
}
mutate {
convert => {"percentage" => "float"}
}
translate {
dictionary_path => "/opt/parquet/input1.csv"
field => "id"
destination => "name"
}
}