Hi All,
We are parsing the data from Database columns using jbdc plugin in logstash , but for some of the records in the database it is showing below error in the log files.
scratching my head to solve this.
========================================================================
[2019-04-22T18:19:25,640][ERROR][logstash.outputs.elasticsearch] An unknown error occurred sending a bulk request to Elasticsearch. We will retry indefinitely {:error_m
essage=>""\xC3" from ASCII-8BIT to UTF-8", :error_class=>"LogStash::Json::GeneratorError", :backtrace=>["/opt/elk7/logstash-7.0.0/logstash-core/lib/logstash/json.rb:
27:in jruby_dump'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/http_client.r b:119:inblock in bulk'", "org/jruby/RubyArray.java:2577:in map'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.0.1-java/ lib/logstash/outputs/elasticsearch/http_client.rb:119:inblock in bulk'", "org/jruby/RubyArray.java:1792:in each'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5. 0/gems/logstash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/http_client.rb:117:inbulk'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/g
ems/logstash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/common.rb:286:in safe_bulk'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/gems /logstash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/common.rb:191:insubmit'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/gems/logst
ash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/common.rb:159:in retrying_submit'", "/opt/elk7/logstash-7.0.0/vendor/bundle/jruby/2.5.0/gems/lo gstash-output-elasticsearch-10.0.1-java/lib/logstash/outputs/elasticsearch/common.rb:38:inmulti_receive'", "org/logstash/config/ir/compiler/OutputStrategyExt.java:118
:in multi_receive'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:101:inmulti_receive'", "/opt/elk7/logstash-7.0.0/logstash-core/lib/logstash/jav
a_pipeline.rb:235:in `block in start_workers'"]}
==================================================================
We have just migrated from the elk stack 5.5 to ELK stack 7.0.0 . We are not facing this issue in the lower version ( 5.5 ) but the same is not working in the 7.0.0 version.
We tried below things in the logstash configuration.
jdbc
{
jdbc_connection_string => "jdbc:oracle:thin:@DB_IP:1521/dbName"
jdbc_user => "SCHEMA_NAME"
jdbc_password => "PASSWORD"
jdbc_driver_library => "/opt/elk7/logstash-7.0.0/ojdbc/ojdbc7.jar"
jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"
columns_charset => { "ENCODING" => "UTF-8" }
statement => "select * from v_wli_qs_report where localhost_timestamp >= (systimestamp - interval '0 00:15:00.0' day to second(1))"
}
What change we nned to perform in logstash configuration.
Any help would be appreciated .
Thanks in advance.