# Logstash jdbc for mysql

**URL:** https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738
**Category:** Logstash
**Created:** [December 9, 2015, 12:09pm UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738 "2015-12-09T12:09:40Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![liweigao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liweigao/32/6736_2.png) [@liweigao](https://discuss.elastic.co/u/liweigao)
#### Post date: [December 9, 2015, 12:09pm UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/1 "2015-12-09T12:09:40Z")

</div>

I have 500W data in the database, I use logstash input myspl to es, the service will die, what do I need?

Exception when executing JDBC query {:exception=\>#\<Sequel::DatabaseError: Java::JavaSql::SQLException: Incorrect key file for table '/tmp/#sql\_5f4\_0.MYI'; try to repair it\>, :level=\>:warn}

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [December 10, 2015, 2:50am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/2 "2015-12-10T02:50:15Z")

</div>

Providing your config and the version you are running will be helpful.

---

<div class="post-metadata">

### Author: ![liweigao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liweigao/32/6736_2.png) [@liweigao](https://discuss.elastic.co/u/liweigao)
#### Post date: [December 10, 2015, 2:55am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/3 "2015-12-10T02:55:35Z")

</div>

input {  
jdbc {  
jdbc\_driver\_library =\> "/data/applications/tools/logstash-2.0.0/mysql-connector-java-5.1.28-bin.jar"  
jdbc\_driver\_class =\> "com.mysql.jdbc.Driver"  
jdbc\_connection\_string =\> "jdbc:mysql://120.3.3.20:3323/\_order"  
jdbc\_user =\> "admin"  
jdbc\_password =\> "admin"  
jdbc\_paging\_enabled =\> "true"  
jdbc\_page\_size =\> "5000000"  
schedule =\> "33 \* \* \* \*"  
statement =\> "SELECT \* from tmp\_ticket\_order\_1509 limit 5000000"  
}  
}  
output {  
stdout {codec =\> rubydebug}  
elasticsearch {  
hosts =\> ["localhost:9200"]  
index =\> "mysqltest"  
document\_type =\> "pay\_order\_1512"  
document\_id =\> "%{id}"  
}

# file {

# path =\>"/data/applications/tools/logstash-2.0.0/logs/test.log"

# }

}

this is my config ,logstash version is 2.0 ,elasticsearch is 2.0 too ,thanks you warkolm!

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [December 11, 2015, 2:09am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/4 "2015-12-11T02:09:55Z")

</div>

Have you tried reducing the page size, also increasing LS heap may help.

---

<div class="post-metadata">

### Author: ![liweigao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liweigao/32/6736_2.png) [@liweigao](https://discuss.elastic.co/u/liweigao)
#### Post date: [December 11, 2015, 4:58am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/5 "2015-12-11T04:58:12Z")

</div>

I do that ,but If I'm going to import 500W data, I'm going to write a lot of.Conf files right? thank you warkolm.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [December 11, 2015, 10:04pm UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/6 "2015-12-11T22:04:14Z")

</div>

No, because it will page though the entire table.

---

<div class="post-metadata">

### Author: ![liweigao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liweigao/32/6736_2.png) [@liweigao](https://discuss.elastic.co/u/liweigao)
#### Post date: [December 19, 2015, 9:53am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/7 "2015-12-19T09:53:07Z")

</div>

> [@liweigao](#):
>
> I do that ,but If I'm going to import 500W data, I'm going to write a lot of.Conf files right? thank you warkolm.

thank you

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 5:17am UTC](https://discuss.elastic.co/t/logstash-jdbc-for-mysql/36738/8 "2017-07-06T05:17:50Z")

</div>