Logstash (jdbc_static) : Exception when filling lookup db from loader

Elastic Stack Logstash
1

Hi, This is my confing:

loader_schedule => "* */1 * * *"
jdbc_user => "logstash"
jdbc_password => "password"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_connection_string => "jdbc:mysql://x.x.x.x.:3306/mydb"
staging_directory => "/tmp/logstash/jdbc_static/import_data/"

I got this error in log file:

[2020-08-31T17:11:03,134][ERROR][logstash.filters.jdbc.readwritedatabase][main] Exception when filling lookup db from loader productstable, query results, original exception: Sequel::DatabaseError, original message: Java::JavaSql::SQLException: Import error on line 899 of file /tmp/logstash/jdbc_static/import_data/productslocal: Read end of file at unexpected place on line 899. {:backtrace=>["org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.Util.seeNextException(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(org/apache/derby/impl/jdbc/TransactionResourceImpl)", "org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(org/apache/derby/impl/jdbc/TransactionResourceImpl)", "org.apache.derby.impl.jdbc.EmbedConnection.handleException(org/apache/derby/impl/jdbc/EmbedConnection)", "org.apache.derby.impl.jdbc.ConnectionChild.handleException(org/apache/derby/impl/jdbc/ConnectionChild)", "org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(org/apache/derby/impl/jdbc/EmbedStatement)", "org.apache.derby.impl.jdbc.EmbedStatement.execute(org/apache/derby/impl/jdbc/EmbedStatement)", "org.apache.derby.impl.jdbc.EmbedStatement.execute(org/apache/derby/impl/jdbc/EmbedStatement)", "jdk.internal.reflect.GeneratedMethodAccessor58.invoke(jdk/internal/reflect/GeneratedMethodAccessor58)", "jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(jdk/internal/reflect/DelegatingMethodAccessorImpl.java:43)", "java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:566)", "org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(org/jruby/javasupport/JavaMethod.java:455)", "org.jruby.javasupport.JavaMethod.invokeDirect(org/jruby/javasupport/JavaMethod.java:316)", "usr.share.logstash.vendor.bundle.jruby.$2_dot_5_dot_0.gems.sequel_minus_5_dot_25_dot_0.lib.sequel.adapters.jdbc.execute(/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.25.0/lib/sequel/adapters/jdbc.rb:260)"]}

or

'java.sql.SQLException: Data file not found: /tmp/logstash/jdbc_static/import_data/producertable' was thrown while evaluating an expression.

The logstash user has read/write access on /tmp/logstash : drwxr-xr-x logstash:logstash
what did I do wrong ? I see some docs on elasticsearch that looks like jdbc_static filter not working all the time.
thanx a lot

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.