Prevent Logstash from stopping

Elastic Stack Logstash
1

Hello,

I currently use Logstash to retrieve data from a SQL Database and send it my Elasticsearch cluster.

I run Logstash with a command line (service won't work but it's another issue):

/opt/logstash/bin/logstash --config /etc/logstash/conf.d/logstash.conf

My problem is that whenever Logstash reaches the end of my SQL Database, it stops running and I won't be able to read new entries automatically and I want to keep it running so it'll read them and send them to Elasticsearch.

I guess I'm missing something in my configuration and I can't find what it is :

input {
jdbc {
jdbc_connection_string => "jdbc:jtds:sqlserver: xxx
jdbc_user => "xxx"
jdbc_password => "xxx$$"
jdbc_validate_connection => true
jdbc_driver_library => "/root/jtds-1.3.1.jar"
jdbc_driver_class => "Java::net.sourceforge.jtds.jdbc.Driver"
statement => "xxx"
}

}

output {
elasticsearch {
hosts => ["host:9200"]
index => "event-%{+YYYY.MM.dd}
}
}

Thank you,

2

I think https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#_scheduling will get what you want

3

Oh yes, that's it, thank you. I completely forgot about the scheduling part.