# Logstash sql\_last\_run took last record twice

**URL:** <https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617>\
**Category:** Logstash\
**Created:** [March 6, 2018, 1:15am UTC](https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617 "2018-03-06T01:15:23Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Timotius\_Pamungkas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timotius_pamungkas/32/42522_2.png) [@Timotius\_Pamungkas](https://discuss.elastic.co/u/Timotius_Pamungkas)\
**Post date:** [March 6, 2018, 1:15am UTC](https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617/1 "2018-03-06T01:15:23Z")

</div>

I use logstash to parse log data from SQL Server, using jdbc input. The jdbc runs every hour. However, every last log entry on previous hour sometimes taken twice by logstash.

For example, the following sequence:

[1. log\_id : 101, log\_timestamp: 14:12]  
2. [log\_id : 102, log\_timestamp: 14:13]  
3. [log\_id : 103, log\_timestamp: 14:14] \> double input for logstash  
4. [log\_id : 201, log\_timestamp: 15:28]  
5. [log\_id : 202, log\_timestamp: 15:29]  
6. [log\_id : 203, log\_timestamp: 15:30] \> double input for logstash

Logstash jdbc will runs on 15:03 and 16:03, but it will took 8 records, where log\_id 103 and 203 taken twice.  
The\* log\_id 103 will be taken by scheduler on 15:03 and 16:03

- The log\_id 203 will be taken by scheduler on 16:03 and 17:03

However, other log\_id is normal  
I check the sql\_last\_run value:

- after 15:03 scheduler runs, the value of sql\_last\_run is 14:14
- after 16:03 scheduler runs, the value of sql\_last\_run is 15:30

Is there something I miss?

Thanks

Here is my config

```
	input { 
  # xyz hit rate
  jdbc {
	jdbc_driver_library => "C:\dev\script\config\mssql-jdbc-6.2.2.jre8.jar"
	jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
	jdbc_connection_string => "jdbc:sqlserver://1.2.3.4:1433;databaseName=MYDB;"
	jdbc_user => "user"
	jdbc_password => "password"
	jdbc_validate_connection => true
	schedule => "3 * * * *"
	statement => "SELECT * from myTableLog WHERE DtmUpd > :sql_last_value"
	type => "jdbc"
	tags => ["xyz-hit-rate"]
	tracking_column => "dtmupd"
	use_column_value => true
	last_run_metadata_path => "C:\dev\script\sql\es-jdbc-last-run-btpn.log"
  }
}
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 3, 2018, 1:15am UTC](https://discuss.elastic.co/t/logstash-sql-last-run-took-last-record-twice/122617/2 "2018-04-03T01:15:26Z")

</div>

Closed on April 3, 2018, 1:15am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.