After adding the config file with the mysql driver, the data is no longer sent to the elastic


(Igor) #1

In the logstash configuration files with PostgreSQL queries already existed. After adding the config file with mysql, after some time the data ceases to arrive in the elastic, tcpdump on the outgoing port also shows the absence of data, while requests to other servers are made. There are no errors in the logs. When debug is enabled, it shows that the config is re-read and that's it.
On another server, where this config is only one, logstash works fine.
In what there can be an error? Where to look. Tell me please.

input {
  jdbc {
    jdbc_driver_library => "/etc/logstash/mysql-connector-java-5.1.46-bin.jar"
    jdbc_driver_class => "com.mysql.jdbc.Driver"
    jdbc_connection_string => "jdbc:mysql://xx.xx.xx.xx:3306/database"
    jdbc_user => "user"
    jdbc_password => "*************"
    schedule => "0-59 * * * *"
    statement => "SELECT * FROM `database`.table WHERE calldate > :sql_last_value"
    tracking_column => "calldate"
    tracking_column_type => "timestamp"
    use_column_value => true
    add_field => { "typetable_id" => "table" }
  }
}
output {
        if [typetable_id] == "table" {
            elasticsearch {
                    hosts => "xx.xx.xx.xx:9200"
                    index => "data_index"
                    user => "elastic"
                    password => "***********"
              }
       }
}

(Igor) #2

I found a solution. Increased the parameters -xms -xmx. After processing all the data, reduced these values to the original ones


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.