Eliminate duplicates from Kibana dashboard from a particular column

Elastic Stack Kibana
1

I have a ELK Dashboard which consumes data from kafka.
There are 4 columns in the inputted JSON data. For example columns are col1,col2,col3,col4.

There are 100 records which are fed to elastic search everyday.

Suppose i want to eliminate duplicates based on a particular column say col1 , is there a way to do on kibana dashboard.

2

I believe what you are looking for is this: Remove duplicate documents from a search in kibana4. If so, as that thread says, this isn't currently available in Kibana but please +1 the issue for it with a link to this this post: https://github.com/elastic/kibana/issues/3546