Logstash duplicate index data

Elastic Stack Elasticsearch
1

Hi,

Am trying to load 4TB of data into my elastic search server
Am using java bulk api for one time load, after which am using logstash to poll and update the existing index for any delta update.

But first time after creating index using bulk api and when I run logstash with sql_last_value ,it recreates all the documents that already exist in index.

Am using nested structure for my documents

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.