Hi, I am trying to merge 3 csv files which have columns like: 1st CSV: [oid, symbol, price, qty, side, err1] 2nd CSV: [oid, tid, symbol, price, qty, side, err2, error_msg] 3rd CSV: [tid, symbol, price, qty, side, err3] Now as you can see, i have to map oid of 1st csv with tid of 2nd csv and als…

Logstash isn't the right tool for that task.

I implemented the same using ruby filter plugin. My logstash config is something like this :- input { file { path => "/usr/share/logstash/bin/csvt1/*.csv" start_position => "beginning" sincedb_path => "/dev/null" } } filter { if "Book0" in [path] { mutate { replace => { "type" => "B…

Merge 3 CSV files based on related column

Elastic Stack Logstash

ravi_yadav1 (slimshady) September 17, 2018, 7:21am 3

@magnusbaeck Thanks for replying!

So can you please give me some insight about the tools that will be required? Or can you give me the link of some blog related to similar use cases.

Topic		Replies	Views
Merge 3 CSV files based on common column Elasticsearch	2	580	October 13, 2018
Merge data from several csv sources Logstash	5	358	January 19, 2021
Is there anyway for logstash to join two csv files(m:m relationship) based on a common field, and ingest the data into one single index Logstash	1	380	September 17, 2019
Logstash configuration file in joining two csv files based on primary key Logstash	2	506	January 20, 2022
Logstash plugin for reference data Logstash	4	333	May 11, 2018

Merge 3 CSV files based on related column

Related topics