# Logstash issue with duplicates of logs

**URL:** <https://discuss.elastic.co/t/logstash-issue-with-duplicates-of-logs/373599>\
**Category:** Logstash\
**Created:** [January 23, 2025, 7:46pm UTC](https://discuss.elastic.co/t/logstash-issue-with-duplicates-of-logs/373599 "2025-01-23T19:46:22Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![arcsons](https://avatars.discourse-cdn.com/v4/letter/a/5fc32e/32.png) [@arcsons](https://discuss.elastic.co/u/arcsons)\
**Post date:** [January 23, 2025, 7:46pm UTC](https://discuss.elastic.co/t/logstash-issue-with-duplicates-of-logs/373599/1 "2025-01-23T19:46:22Z")

</div>

Hello,  
I have a simple logstash.conf file that looks something like this. When using Filebeat, it remembered which logs were sent to Elasticsearch. How can I implement a similar solution for Logstash? Currently, it's sending duplicate logs.

```auto
input {
  file {
    path => "/home/user/test.json"
    start_position => "beginning"
    sincedb_path => "/var/lib/logstash/sincedb"
    mode => "read"
    codec => "json"
  }
}

 output {
  elasticsearch {
    hosts => ["https://10.10.10.10:9200"]
    ssl => true
    ssl_certificate_verification => false
    index => "test-%{+yyyy.MM.dd}"
    user => "${ELASTIC_USER}"
    password => "${ELASTIC_PASSWORD}

  }
  stdout {
    codec => rubydebug
  }
}

```
