# Logstash Reading Same Data

**URL:** <https://discuss.elastic.co/t/logstash-reading-same-data/312251>\
**Category:** Logstash\
**Created:** [August 17, 2022, 7:25am UTC](https://discuss.elastic.co/t/logstash-reading-same-data/312251 "2022-08-17T07:25:18Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mehmetalix](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmetalix/32/100571_2.png) [@mehmetalix](https://discuss.elastic.co/u/mehmetalix)\
**Post date:** [August 17, 2022, 7:25am UTC](https://discuss.elastic.co/t/logstash-reading-same-data/312251/1 "2022-08-17T07:25:19Z")

</div>

Hi,

I have a logstash .conf:

```auto
input {
    jdbc {
        jdbc_driver_library => "${LOGSTASH_JDBC_DRIVER_JAR_LOCATION}"
        jdbc_driver_class => "${LOGSTASH_JDBC_DRIVER}"
        jdbc_connection_string => "${LOGSTASH_JDBC_URL}"
        jdbc_user => "${LOGSTASH_JDBC_USERNAME}"
        jdbc_password => "${LOGSTASH_JDBC_PASSWORD}"
        schedule => "* * * * *"
        statement => "select * from testtable"
    }
}

filter {
  mutate {
  	add_field => { "message" => "%{time}" }
          convert => ["time", "string"]
  }
  date {
      timezone => "Etc/GMT+3"
      match => ["time" , "ISO8601", "yyyy-MM-dd HH:mm:ss.SSS"]
      target => "@timestamp"
      remove_field => ["time", "timestamp"]
  }
  fingerprint {
    source => ["testid", "programid", "unitid"]
    target => "[@metadata][fingerprint]"
    method => "MD5"
    key => "${LOGSTASH_JDBC_PASSWORD}"
  }
  ruby {
    code => "event.set('[@metadata][tsprefix]', event.get('@timestamp').to_i.to_s(16))"
  }
}

output {
    elasticsearch {
        hosts => ["${LOGSTASH_ELASTICSEARCH_HOST}"]
        user => "${ELASTIC_USER}"
        password => "${ELASTIC_PASSWORD}"
        index => "heartbeat"
        document_id => "%{[@metadata][tsprefix]}%{[@metadata][fingerprint]}"
    }
    stdout { codec => json_lines }
}

```

And Logstash keeps reading same data over and over again, Index Count does not increase in Elasticsearch but size of it does. (Database: Postgresql 14.5, JDBC Driver: 42.4.1)  
Can you help me understand the reason?

---

<div class="post-metadata">

**Author:** ![mehmetalix](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmetalix/32/100571_2.png) [@mehmetalix](https://discuss.elastic.co/u/mehmetalix)\
**Post date:** [August 18, 2022, 6:49am UTC](https://discuss.elastic.co/t/logstash-reading-same-data/312251/2 "2022-08-18T06:49:22Z")

</div>

Also tried:

```auto
use_column_value => true
tracking_column => "time"

```

But did not resolve my problem.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 15, 2022, 6:49am UTC](https://discuss.elastic.co/t/logstash-reading-same-data/312251/3 "2022-09-15T06:49:46Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.