# Logstash - not pushing all data into elasticsearch
**URL:** https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523
**Category:** Logstash
**Created:** [September 4, 2020, 11:13am UTC](https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523 "2020-09-04T11:13:32Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@SwatiD](https://discuss.elastic.co/u/SwatiD)
#### Post date: [September 4, 2020, 11:13am UTC](https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523/1 "2020-09-04T11:13:32Z")
I have 7,00,000 records with 300 columns in my database,but when I am pushing it into elasticsearch through logstash,It is pushing records samething like 2,50,000 only.
I have use below in logstash config file
useCursorFetch=true
jdbc\_fetch\_size =\> 50000
still not working and not giving any error .
Thanks
---
### Author:  [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)
#### Post date: [September 4, 2020, 3:18pm UTC](https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523/2 "2020-09-04T15:18:59Z")
Are you using [paging](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#plugins-inputs-jdbc-jdbc_paging_enabled)?
Do you have any filters?
Posting the configuration would help see what's going on.
Might try adding the below.
```auto
jdbc_paging_enabled => true
jdbc_page_size => 50000
```
---
### Author:  [@SwatiD](https://discuss.elastic.co/u/SwatiD)
#### Post date: [September 7, 2020, 4:39am UTC](https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523/3 "2020-09-07T04:39:48Z")
My logstash config file
input {
jdbc {
jdbc\_driver\_library =\>"mysql-connector-java-8.0.16/mysql-connector-java-8.0.16.jar"
jdbc\_driver\_class =\> "com.mysql.cj.jdbc.Driver"
jdbc\_connection\_string =\> "jdbc:mysql://localhost:3306/testdb?serverTimezone=Asia/Kolkata&zeroDateTimeBehavior=convertToNull&useCursorFetch=true"
jdbc\_user =\> "root"
jdbc\_password =\> ""
tracking\_column =\> "unix\_ts\_in\_secs"
use\_column\_value=\>true
jdbc\_fetch\_size =\> 50000
jdbc\_default\_timezone =\> "Asia/Kolkata"
statement =\> "SELECT
applicationNo,
endDate,
ccmaping._,
UNIX\_TIMESTAMP(modifyOn) AS unix\_ts\_in\_secs
FROM
`ccmaping`
WHERE
(UNIX\_TIMESTAMP(modifyOn) \> :sql\_last\_value AND modifyOn \< NOW())"
schedule =\> "_/5 \* \* \* \* \*"
}
}
filter {
date {
match =\> ["endDate", "YYYY-MM-DD hh:mm:ss"]
timezone =\> "Asia/Kolkata"
target =\> "endDate"
}
}
output {
elasticsearch {
document\_type =\> "\_doc"
document\_id=\> "%{id}"
index =\> "testindex"
hosts =\> ["[[http://localhost:9200](http://localhost:9200)"]
```
}
```
stdout{
codec =\> rubydebug
}
}
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 5, 2020, 4:39am UTC](https://discuss.elastic.co/t/logstash-not-pushing-all-data-into-elasticsearch/247523/4 "2020-10-05T04:39:55Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.