Logstash error : org.logstash.instrument.metrics.gauge.LazyDelegatingGauge while processing data

Elastic Stack Logstash
1

I am getting below error while processing data:
[2020-05-28T11:35:29,467][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge][main] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been created for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.

Logstash version: 7.7.0

My config file is-
input{
file {
path => "D:/ELK/529942_1182360_bundle_archive/sars_2003_complete_dataset_clean.csv"
sincedb_path => "NUL"
}
}

filter {
csv {
separator => ","
columns => ["Date","Country","Cumulative number of case(s)","Number of deaths","Number recovered"]
}
}
output{
elasticsearch{
hosts => "localhost:9200"
index => "sarsindex"
}

stdout {}

}

If I have tried few solution from internet, but no luck.

2

That message has been occurring in the last few versions. I ignore it since it seems to do no harm.

3

Thanks Badger for replying. But no data is getting uploaded in Kibana.
Below the complete logs of Logstash. Can you give me some point why data is not getting uploaded or am I doing anything wrong.

Sending Logstash logs to D:/ELK/logstash-7.7.0/logstash-7.7.0/logs which is now configured via log4j2.properties
[2020-05-29T11:30:49,622][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2020-05-29T11:30:49,771][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.7.0"}
[2020-05-29T11:30:51,553][INFO ][org.reflections.Reflections] Reflections took 42 ms to scan 1 urls, producing 21 keys and 41 values
[2020-05-29T11:30:55,366][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=>[http://localhost:9200/]}}
[2020-05-29T11:30:55,637][WARN ][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"http://localhost:9200/"}
[2020-05-29T11:30:55,697][INFO ][logstash.outputs.elasticsearch][main] ES Output version determined {:es_version=>7}
[2020-05-29T11:30:55,703][WARN ][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the type event field won't be used to determine the document _type {:es_version=>7}
[2020-05-29T11:30:55,800][INFO ][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//localhost:9200"]}
[2020-05-29T11:30:55,864][INFO ][logstash.outputs.elasticsearch][main] Using default mapping template
[2020-05-29T11:30:55,939][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge][main] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been created for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
[2020-05-29T11:30:55,940][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>4, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>500, "pipeline.sources"=>["D:/ELK/logstash-7.7.0/logstash-7.7.0/bin/logstash.conf"], :thread=>"#<Thread:0x948966 run>"}
[2020-05-29T11:30:55,965][INFO ][logstash.outputs.elasticsearch][main] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
[2020-05-29T11:30:58,006][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"}
[2020-05-29T11:30:58,093][INFO ][filewatch.observingtail ][main][dcd182b6dd849dadb5ccfc8c16ddcd91f46c3f31582d19a8bf525a38bbc86d55] START, creating Discoverer, Watch with file and sincedb collections
[2020-05-29T11:30:58,097][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>}
[2020-05-29T11:30:58,617][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

Also if I add start_postion => "beginning" tag in conf file, I am getting below error:

[2020-05-29T11:42:57,481][ERROR][logstash.inputs.file ] Unknown setting 'start_postion' for file
[2020-05-29T11:42:57,496][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"Java::JavaLang::IllegalStateException", :message=>"Unable to configure plugins: (ConfigurationError) Something is wrong with your configuration.", :backtrace=>["org.logstash.config.ir.CompiledPipeline.(CompiledPipeline.java:126)", "org.logstash.execution.JavaBasePipelineExt.initialize(JavaBasePipelineExt.java:80)", "org.logstash.execution.JavaBasePipelineExt$INVOKER$i$1$0$initialize.call(JavaBasePipelineExt$INVOKER$i$1$0$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:837)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1169)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuperSplatArgs(IRRuntimeHelpers.java:1156)",

LogStash::Error: Don't know how to handle Java::JavaLang::IllegalStateException for PipelineAction::Create<main>
create at org/logstash/execution/ConvergeResultExt.java:129
add at org/logstash/execution/ConvergeResultExt.java:57
converge_state at D:/ELK/logstash-7.7.0/logstash-7.7.0/logstash-core/lib/logstash/agent.rb:355
[2020-05-29T11:42:57,516][ERROR][logstash.agent ] An exception happened when converging configuration {:exception=>LogStash::Error, :message=>"Don't know how to handle Java::JavaLang::IllegalStateException for PipelineAction::Create<main>", :backtrace=>["org/logstash/execution/ConvergeResultExt.java:129:in create'", "org/logstash/execution/ConvergeResultExt.java:57:in add'", "D:/ELK/logstash-7.7.0/logstash-7.7.0/logstash-core/lib/logstash/agent.rb:355:in block in converge_state'"]} [2020-05-29T11:42:57,638][FATAL][logstash.runner ] An unexpected error occurred! {:error=>#<LogStash::Error: Don't know how to handle Java::JavaLang::IllegalStateExceptionforPipelineAction::Create>, :backtrace=>["org/logstash/execution/ConvergeResultExt.java:129:in create'", "org/logstash/execution/ConvergeResultExt.java:57:in add'", "D:/ELK/logstash-7.7.0/logstash-7.7.0/logstash-core/lib/logstash/agent.rb:355:in block in converge_state'"]}
[2020-05-29T11:42:57,665][ERROR][org.logstash.Logstash ] java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit

Please help me out.

Regards,
Sandeep

4

this shows it’s working. you could try changing logstash output to stdout {} to make sure that your config is producing output

don’t use quotes with beginning

5

this shows it’s working. you could try changing logstash output to stdout {} to make sure that your config is producing output[quote="ptamba, post:4, topic:234695"]
this shows it’s working. you could try changing logstash output to stdout {} to make sure that your config is producing output
[/quote]

I am using stdout{}, same results.

I tried it, giving same error.

6

it should be start_position? typo there

7

That should be

start_position => "beginning"
8

Thanks, it worked.Its due to the typo mistake.

9

Thanks, it worked

10

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.