[ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of #,

Elastic Stack Logstash
1

Following is my config file:

input {
file{
path => "C:\Users\shraddhasrivastav\Downloads\cars.csv"
start_position => "beginning"
sincedb_path => "dev/null"
}

stdin { 

	}

}

filter{
csv{
columns => ["TimeOfDay", "BMU_Debug_Wnty_Tot_s_NRuntwo","RBMU_Stats_Temp_Cell_Max"]
}

mutate {convert => ["TimeOfDay", "timestamp"]  }
mutate {convert => ["BMU_Debug_Wnty_Tot_s_NRuntwo", "integer"] }
mutate {convert => ["RBMU_Stats_Temp_Cell_Max", "float"]  }

}

output {
elasticsearch { hosts => ["localhost:9200"] }

}

stdout {}

Error

[2018-07-11T17:01:49,442][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>1}
[2018-07-11T17:01:49,466][DEBUG][logstash.agent ] Executing action {:action=>LogStash::PipelineAction::Create/pipeline_id:main}
[2018-07-11T17:01:50,224][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of #, input, filter, output at line 29, column 1 (byte 526) after ", :backtrace=>["C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/compiler.rb:42:in compile_imperative'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/compiler.rb:50:incompile_graph'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/compiler.rb:12:in block in compile_sources'", "org/jruby/RubyArray.java:2486:inmap'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/compiler.rb:11:in compile_sources'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:49:ininitialize'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:167:in initialize'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline_action/create.rb:40:inexecute'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/agent.rb:305:in `block in converge_state'"]}
[2018-07-11T17:01:50,376][DEBUG][logstash.agent ] Starting puma
[2018-07-11T17:01:50,401][DEBUG][logstash.instrument.periodicpoller.os] Stopping
[2018-07-11T17:01:50,406][DEBUG][logstash.agent ] Trying to start WebServer {:port=>9600}
[2018-07-11T17:01:50,456][DEBUG][logstash.instrument.periodicpoller.jvm] Stopping
[2018-07-11T17:01:50,467][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Stopping
[2018-07-11T17:01:50,469][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Stopping
[2018-07-11T17:01:50,546][DEBUG][logstash.api.service ] [api-service] start
[2018-07-11T17:01:50,883][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2018-07-11T17:01:55,620][DEBUG][logstash.agent ] Shutting down all pipelines {:pipelines_count=>0}
[2018-07-11T17:01:55,622][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>0}

please help to fix this!

2

Start by putting stdout {} inside the output block.

sincedb_path => "dev/null"

While unrelated to the error message you quote, change "dev/null" to "nul".

3

Hey,

Thanks for replying. I did the necessary changes it still gives the same following error:

[2018-07-12T09:08:49,422][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"template"=>"logstash-", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s"}, "mappings"=>{"default"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}}
[2018-07-12T09:08:49,523][DEBUG][logstash.outputs.elasticsearch] Found existing Elasticsearch template. Skipping template management {:name=>"logstash"}
[2018-07-12T09:08:49,610][ERROR][logstash.pipeline ] Error registering plugin {:pipeline_id=>"main", :plugin=>"#<LogStash::FilterDelegator:0x1dc3925f @metric_events_out=org.jruby.proxy.org.logstash.instrument.metrics.counter.LongCounter$Proxy2 - name: out value:0, @metric_events_in=org.jruby.proxy.org.logstash.instrument.metrics.counter.LongCounter$Proxy2 - name: in value:0, @metric_events_time=org.jruby.proxy.org.logstash.instrument.metrics.counter.LongCounter$Proxy2 - name: duration_in_millis value:0, @id="85f0a6661e074ec8ff1f4587d3d1ab7c7c56a14c88a61342135d1d2bb913eb8a", @klass=LogStash::Filters::Mutate, @metric_events=#<LogStash::Instrument::NamespacedMetric:0x4cff0f6d @metric=#<LogStash::Instrument::Metric:0x33da489f @collector=#<LogStash::Instrument::Collector:0x38430eb8 @agent=nil, @metric_store=#<LogStash::Instrument::MetricStore:0x39132285 @store=#<Concurrent::map:0x00000000000fb0 entries=2 default_proc=nil>, @structured_lookup_mutex=#Mutex:0x4cca1cdb, @fast_lookup=#<Concurrent::map:0x00000000000fb4 entries=66 default_proc=nil>>>>, @namespace_name=[:stats, :pipelines, :main, :plugins, :filters, :"85f0a6661e074ec8ff1f4587d3d1ab7c7c56a14c88a61342135d1d2bb913eb8a", :events]>, @filter=<LogStash::Filters::Mutate convert=>{"TimeOfDay"=>"timestamp", "BMU_Debug_Wnty_Tot_s_NRuntwo"=>"integer", "RBMU_Stats_Temp_Cell_Max"=>"float"}, id=>"85f0a6661e074ec8ff1f4587d3d1ab7c7c56a14c88a61342135d1d2bb913eb8a", enable_metric=>true, periodic_flush=>false>>", :error=>"translation missing: en.logstash.agent.configuration.invalid_plugin_register", :thread=>"#<Thread:0x7f683d43 run>"}
[2018-07-12T09:08:49,649][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-07-12T09:08:49,679][DEBUG][logstash.filters.csv ] Closing {:plugin=>"LogStash::Filters::CSV"}
[2018-07-12T09:08:49,719][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2018-07-12T09:08:49,766][ERROR][logstash.pipeline ] Pipeline aborted due to error {:pipeline_id=>"main", :exception=>#<LogStash::ConfigurationError: translation missing: en.logstash.agent.configuration.invalid_plugin_register>, :backtrace=>["C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/vendor/bundle/jruby/2.3.0/gems/logstash-filter-mutate-3.3.2/lib/logstash/filters/mutate.rb:219:in block in register'", "org/jruby/RubyHash.java:1343:ineach'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/vendor/bundle/jruby/2.3.0/gems/logstash-filter-mutate-3.3.2/lib/logstash/filters/mutate.rb:217:in register'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:340:inregister_plugin'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:351:in block in register_plugins'", "org/jruby/RubyArray.java:1734:ineach'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:351:in register_plugins'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:729:inmaybe_setup_out_plugins'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:361:in start_workers'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:288:inrun'", "C:/Users/shraddhasrivastav/Downloads/logstash-6.3.1/logstash-core/lib/logstash/pipeline.rb:248:in `block in start'"], :thread=>"#<Thread:0x7f683d43 run>"}
[2018-07-12T09:08:49,814][ERROR][logstash.agent ] Failed to execute action {:id=>:main, :action_type=>LogStash::ConvergeResult::FailedAction, :message=>"Could not execute action: PipelineAction::Create, action_result: false", :backtrace=>nil}
[2018-07-12T09:08:49,898][DEBUG][logstash.agent ] Starting puma
[2018-07-12T09:08:49,945][DEBUG][logstash.instrument.periodicpoller.os] Stopping
[2018-07-12T09:08:49,946][DEBUG][logstash.agent ] Trying to start WebServer {:port=>9600}
[2018-07-12T09:08:50,008][DEBUG][logstash.instrument.periodicpoller.jvm] Stopping
[2018-07-12T09:08:50,020][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Stopping
[2018-07-12T09:08:50,034][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Stopping
[2018-07-12T09:08:50,089][DEBUG][logstash.api.service ] [api-service] start
[2018-07-12T09:08:50,400][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2018-07-12T09:08:55,144][DEBUG][logstash.agent ] Shutting down all pipelines {:pipelines_count=>1}
[2018-07-12T09:08:55,153][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>1}
[2018-07-12T09:08:55,164][DEBUG][logstash.agent ] Executing action {:action=>LogStash::PipelineAction::Stop/pipeline_id:main}
[2018-07-12T09:08:55,198][DEBUG][logstash.pipeline ] Stopping inputs {:pipeline_id=>"main", :thread=>"#<Thread:0x7f683d43 dead>"}
[2018-07-12T09:08:55,206][DEBUG][logstash.inputs.file ] Stopping {:plugin=>"LogStash::Inputs::File"}
[2018-07-12T09:08:55,212][DEBUG][logstash.inputs.stdin ] Stopping {:plugin=>"LogStash::Inputs::Stdin"}
[2018-07-12T09:08:55,219][DEBUG][logstash.pipeline ] Stopped inputs {:pipeline_id=>"main", :thread=>"#<Thread:0x7f683d43 dead>"}

4

@magnusbaeck please help to sort this! TIA

5

As documented, "timestamp" is not a valid conversion type for the mutate filter's convert option. I think the csv filter can parse timestamps, but otherwise the date filter is what's normally used for this.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.