Error while load logstash config

hi expert,

I'm still newbie in ES. I have problem with my logstash where there are some failed that no index in my ES after load the config. Below is my log file and show the failed to execute action. Please advice further

[2019-10-17T11:17:50,416][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2019-10-17T11:17:50,448][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.3.0"}
[2019-10-17T11:17:53,314][INFO ][org.reflections.Reflections] Reflections took 57 ms to scan 1 urls, producing 19 keys and 39 values
[2019-10-17T11:17:56,853][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=>[http://10.10.130.20:9200/]}}
[2019-10-17T11:17:57,199][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://10.10.130.20:9200/"}
[2019-10-17T11:17:57,344][INFO ][logstash.outputs.elasticsearch] ES Output version determined {:es_version=>7}
[2019-10-17T11:17:57,352][WARN ][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the type event field won't be used to determine the document _type {:es_version=>7}
[2019-10-17T11:17:57,410][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//10.10.130.20:9200"]}
[2019-10-17T11:17:57,534][INFO ][logstash.outputs.elasticsearch] Using default mapping template
[2019-10-17T11:17:57,620][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
[2019-10-17T11:17:57,628][INFO ][logstash.javapipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>4, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>500, :thread=>"#<Thread:0x380fb0a4 run>"}
[2019-10-17T11:17:57,643][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
[2019-10-17T11:17:59,423][ERROR][logstash.javapipeline ] Pipeline aborted due to error {:pipeline_id=>"main", :exception=>#<TypeError: no implicit conversion of Integer into String>, :backtrace=>["uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/date/format.rb:335:in _parse'", "uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/date.rb:734:inparse'", "C:/Elastic/logstash-7.3.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/value_tracking.rb:87:in set_value'", "C:/Elastic/logstash-7.3.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/value_tracking.rb:36:ininitialize'", "C:/Elastic/logstash-7.3.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/value_tracking.rb:29:in build_last_value_tracker'", "C:/Elastic/logstash-7.3.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:216:inregister'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:192:in block in register_plugins'", "org/jruby/RubyArray.java:1792:ineach'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:191:in register_plugins'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:292:instart_inputs'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:248:in start_workers'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:146:inrun'", "C:/Elastic/logstash-7.3.0/logstash-core/lib/logstash/java_pipeline.rb:105:in `block in start'"], :thread=>"#<Thread:0x380fb0a4 run>"}
[2019-10-17T11:17:59,449][ERROR][logstash.agent ] Failed to execute action {:id=>:main, :action_type=>LogStash::ConvergeResult::FailedAction, :message=>"Could not execute action: PipelineAction::Create, action_result: false", :backtrace=>nil}
[2019-10-17T11:17:59,796][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2019-10-17T11:18:04,670][INFO ][logstash.runner ] Logstash shut down.

The jdbc input is failing to parse the sql_last_value that it has persisted. This could happen if you update the query so that it tracks a sequence rather than a timestamp (or vice versa). The default location for the file it persists the value in is "#{ENV['HOME']}/.logstash_jdbc_last_run", try removing that file.

1 Like

its work Badger....thanks

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.