I have a ELK Dashboard which consumes data from kafka.
There are 4 columns in the inputted JSON data. For example columns are col1,col2,col3,col4.
There are 100 records which are fed to elastic search everyday.
Suppose i want to eliminate duplicates based on a particular column say col1 , is there a way to do on kibana dashboard.