Using customized id_key in elasticsearch

Elastic Stack Elasticsearch
1

Hi All,

I am using td-agent v3.3 fluentd and elasticsearch/kibana v6.3.
I have a file containing 5-6 columns and to avoid duplicates want to use customized id_key which I am getting from file right away as in ac_no
My question is when I am setting id_key as ac_no I will be avoiding duplicates if any, but how it will behave for example (due to buffer overflow). Will it lead to any data loss or any data rejection from elasticsearch.

Warm regards,
//Ashlesh

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.