I have a wildcard to ingest multiple .csv files, however in the elastic search visualizations, its adding the same column items together instead of skipping repeat entries. I want to create a data dump where new logs update only new items. I'm pretty sure I read by default it would do this. Is th…

Multiple .csv file data is being added together

warkolm (Mark Walkom) September 12, 2017, 1:23am 2

Can you clarify what you mean by that?

Topic		Replies	Views
Updating data in CSV logstash is pushing the entire CSV file again with updated data which duplicates my records in index. But I just want to sync the data Logstash	14	1952	May 9, 2019
Reg csv file import into Elasticsearch using Logstash Logstash	13	2044	February 26, 2021
Logstash neither detect the newly added data in CSV file nor push it into elasticsearch Logstash	3	735	April 30, 2019
Index multiple csvs Logstash	4	727	March 23, 2017
Problem beetween elastic and logstash: csv files are saved twice Logstash	6	610	July 20, 2020