# Missing records from mysql

**URL:** <https://discuss.elastic.co/t/missing-records-from-mysql/139738>\
**Category:** Logstash\
**Created:** [July 12, 2018, 11:12am UTC](https://discuss.elastic.co/t/missing-records-from-mysql/139738 "2018-07-12T11:12:38Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sunil\_Khullar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sunil_khullar/32/50427_2.png) [@Sunil\_Khullar](https://discuss.elastic.co/u/Sunil_Khullar)\
**Post date:** [July 12, 2018, 11:12am UTC](https://discuss.elastic.co/t/missing-records-from-mysql/139738/1 "2018-07-12T11:12:38Z")

</div>

While fetching records from mysql randomly about 40 - 50% records are getting missed. in the case below I have fetched 10 records only 5 were imported....

* * *

schedule =\> "\* \* \* \* \*"

```
statement => "select * from tbl_activity_log where **time** > '2018-06-01' and **time** >= :sql_last_value order by **time** asc limit 10"

	use_column_value => true
	tracking_column => " **time**"
	tracking_column_type => "timestamp"
	clean_run => true 
	last_run_metadata_path => "d:\es\.logstash_jdbc_last_run_test"
}

```

}

---

<div class="post-metadata">

**Author:** ![Sunil\_Khullar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sunil_khullar/32/50427_2.png) [@Sunil\_Khullar](https://discuss.elastic.co/u/Sunil_Khullar)\
**Post date:** [July 12, 2018, 1:58pm UTC](https://discuss.elastic.co/t/missing-records-from-mysql/139738/2 "2018-07-12T13:58:59Z")

</div>

Resolved. I was using time as \_id. Bad idea as there can be multiple records at the same time.

```
 document_id => "%{time}"
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 9, 2018, 1:58pm UTC](https://discuss.elastic.co/t/missing-records-from-mysql/139738/3 "2018-08-09T13:58:59Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.