I would like to achieve when I write data through the logstash to elasticsearch when the first to elasticsearch Lane investigation or any other way to achieve the removal of duplication of function?

Logstash write data to the elasticsearch how to remove duplication

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Logstash write data to the elasticsearch how to remove duplication