HI All,
I am trying to load a CSV file into elastic by initializing logstash through the below command,
.\bin\logstash -f C:\data\logstash_cars.config
But data is not transferred due to some reason. I am not able to see the data pipeline in the log as well. Could you advice on this. The below is the log file.
C:\logstash-6.0.1>.\bin\logstash -f C:\data\logstash_cars.config
Sending Logstash's logs to C:/logstash-6.0.1/logs which is now configured via lo
g4j2.properties
[2017-12-08T19:32:08,069][INFO ][logstash.modules.scaffold] Initializing module
{:module_name=>"fb_apache", :directory=>"C:/logstash-6.0.1/modules/fb_apache/con
figuration"}
[2017-12-08T19:32:08,085][INFO ][logstash.modules.scaffold] Initializing module
{:module_name=>"netflow", :directory=>"C:/logstash-6.0.1/modules/netflow/configu
ration"}
[2017-12-08T19:32:08,506][WARN ][logstash.config.source.multilocal] Ignoring the
'pipelines.yml' file because modules or command line options are specified
[2017-12-08T19:32:09,961][INFO ][logstash.agent ] Successfully started
Logstash API endpoint {:port=>9600}
[2017-12-08T19:32:15,033][ERROR][logstash.plugins.registry] Problems loading a p
lugin with {:type=>"filter", :name=>"CSV", :path=>"logstash/filters/CSV", :error
_message=>"NameError", :error_class=>NameError, :error_backtrace=>["C:/logstash-
6.0.1/logstash-core/lib/logstash/plugins/registry.rb:226:in namespace_lookup'", "C:/logstash-6.0.1/logstash-core/lib/logstash/plugins/registry.rb:162:inlegac
y_lookup'", "C:/logstash-6.0.1/logstash-core/lib/logstash/plugins/registry.rb:13
8:in lookup'", "C:/logstash-6.0.1/logstash-core/lib/logstash/plugins/registry.r b:180:inlookup_pipeline_plugin'", "C:/logstash-6.0.1/logstash-core/lib/logstas
h/plugin.rb:140:in lookup'", "C:/logstash-6.0.1/logstash-core/lib/logstash/pipe line.rb:143:inplugin'", "(eval):12:in <eval>'", "org/jruby/RubyKernel.java:99 4:ineval'", "C:/logstash-6.0.1/logstash-core/lib/logstash/pipeline.rb:82:in i nitialize'", "C:/logstash-6.0.1/logstash-core/lib/logstash/pipeline.rb:215:ini
nitialize'", "C:/logstash-6.0.1/logstash-core/lib/logstash/pipeline_action/creat
e.rb:35:in execute'", "C:/logstash-6.0.1/logstash-core/lib/logstash/agent.rb:33 5:inblock in converge_state'", "C:/logstash-6.0.1/logstash-core/lib/logstash/a
gent.rb:141:in with_pipelines'", "C:/logstash-6.0.1/logstash-core/lib/logstash/ agent.rb:332:inblock in converge_state'", "org/jruby/RubyArray.java:1734:in e ach'", "C:/logstash-6.0.1/logstash-core/lib/logstash/agent.rb:319:inconverge_s
tate'", "C:/logstash-6.0.1/logstash-core/lib/logstash/agent.rb:166:in block in converge_state_and_update'", "C:/logstash-6.0.1/logstash-core/lib/logstash/agent .rb:141:inwith_pipelines'", "C:/logstash-6.0.1/logstash-core/lib/logstash/agen
t.rb:164:in converge_state_and_update'", "C:/logstash-6.0.1/logstash-core/lib/l ogstash/agent.rb:90:inexecute'", "C:/logstash-6.0.1/logstash-core/lib/logstash
/runner.rb:362:in block in execute'", "C:/logstash-6.0.1/vendor/bundle/jruby/2. 3.0/gems/stud-0.0.23/lib/stud/task.rb:24:inblock in initialize'"]}
[2017-12-08T19:32:15,120][ERROR][logstash.agent ] Failed to execute ac
tion {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"L
ogStash::PluginLoadingError", :message=>"Couldn't find any filter plugin named '
CSV'. Are you sure this is correct? Trying to load the CSV filter plugin resulte
d in this error: Problems loading the requested plugin named CSV of type filter.
Error: NameError NameError", :backtrace=>["C:/logstash-6.0.1/logstash-core/lib/
logstash/plugins/registry.rb:185:in lookup_pipeline_plugin'", "C:/logstash-6.0. 1/logstash-core/lib/logstash/plugin.rb:140:inlookup'", "C:/logstash-6.0.1/logs
tash-core/lib/logstash/pipeline.rb:143:in plugin'", "(eval):12:in'", "o
rg/jruby/RubyKernel.java:994:in eval'", "C:/logstash-6.0.1/logstash-core/lib/lo gstash/pipeline.rb:82:ininitialize'", "C:/logstash-6.0.1/logstash-core/lib/log
stash/pipeline.rb:215:in initialize'", "C:/logstash-6.0.1/logstash-core/lib/log stash/pipeline_action/create.rb:35:inexecute'", "C:/logstash-6.0.1/logstash-co
re/lib/logstash/agent.rb:335:in block in converge_state'", "C:/logstash-6.0.1/l ogstash-core/lib/logstash/agent.rb:141:inwith_pipelines'", "C:/logstash-6.0.1/
logstash-core/lib/logstash/agent.rb:332:in block in converge_state'", "org/jrub y/RubyArray.java:1734:ineach'", "C:/logstash-6.0.1/logstash-core/lib/logstash/
agent.rb:319:in converge_state'", "C:/logstash-6.0.1/logstash-core/lib/logstash /agent.rb:166:inblock in converge_state_and_update'", "C:/logstash-6.0.1/logst
ash-core/lib/logstash/agent.rb:141:in with_pipelines'", "C:/logstash-6.0.1/logs tash-core/lib/logstash/agent.rb:164:inconverge_state_and_update'", "C:/logstas
h-6.0.1/logstash-core/lib/logstash/agent.rb:90:in execute'", "C:/logstash-6.0.1 /logstash-core/lib/logstash/runner.rb:362:inblock in execute'", "C:/logstash-6
.0.1/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/task.rb:24:in `block in
initialize'"]}
C:\logstash-6.0.1>