Logstash Error When Running - Not Sure Of Error


(OpSec Monkey) #1

Good morning everyone. I am running a custom config from a class on Udemy for ElasticSearch, LogStash and Kibana.

For whatever reason I get errors and I cant get it to run. I have been trying over and over and over. Can someone please tell me what I am doing wrong.

Here is my config file.

input {
 file {
 path => "/Users/defensivethinking/search/data/cars.csv"
 start_position => "beginning"
 sincedb_path => "/dev/null"
 }
}
filter {
 csv {
 seperator => ","
 columns => [ "maker", "model", "mileage", "manufacture_year", "engine_displacement", "engine_power", "body_type", "color_slug", "stk_year", "transmission", "door_count", "seat_count", "fuel_type", "date_created", "date_last_seen", "price_eur" ]
 }
 mutate {convert => ["mileage", "integer"] }
 mutate {convert => ["price_eur", "float"] }
 mutate {convert => ["engine_power", "integer"] }
 mutate {convert => ["door_count", "integer"] }
 mutate {convert => ["seat_count", "integer"] }
}
output {
 elasticsearch {
 hosts => "localhost:9200"
 index => "cars"
 document_type => "sold_cars"
 }
 stdout {}
}

I get the same error with or without the port number on localhost

Now when I go to run the config I get a error

Alexs-MacBook-Pro:logstash defensivethinking$ bin/logstash -f /Users/defensivethinking/search/data/logstash_cars.config 
Sending Logstash's logs to /Users/defensivethinking/search/logstash/logs which is now configured via log4j2.properties
[2018-01-04T17:41:41,594][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"/Users/defensivethinking/search/logstash/modules/netflow/configuration"}
[2018-01-04T17:41:41,614][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"/Users/defensivethinking/search/logstash/modules/fb_apache/configuration"}
[2018-01-04T17:41:41,904][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-01-04T17:41:42,753][INFO ][logstash.runner          ] Starting Logstash {"logstash.version"=>"6.1.1"}
[2018-01-04T17:41:43,221][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}
[2018-01-04T17:41:46,468][ERROR][logstash.filters.csv     ] Unknown setting 'seperator' for csv
[2018-01-04T17:41:46,493][ERROR][logstash.agent           ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Something is wrong with your configuration.", :backtrace=>["/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/config/mixin.rb:89:in `config_init'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/filters/base.rb:128:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/filter_delegator.rb:23:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/plugins/plugin_factory.rb:88:in `plugin'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:114:in `plugin'", "(eval):12:in `<eval>'", "org/jruby/RubyKernel.java:994:in `eval'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:86:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:171:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:40:in `execute'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:335:in `block in converge_state'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:141:in `with_pipelines'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:332:in `block in converge_state'", "org/jruby/RubyArray.java:1734:in `each'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:319:in `converge_state'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:166:in `block in converge_state_and_update'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:141:in `with_pipelines'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:164:in `converge_state_and_update'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:90:in `execute'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/runner.rb:343:in `block in execute'", "/Users/defensivethinking/search/logstash/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/task.rb:24:in `block in initialize'"]}

Any help would be great.


(Bryan Vest) #2

This document should help https://www.elastic.co/guide/en/logstash/6.1/plugins-filters-csv.html .

One glaring problem is the mis spelling of seperator


(OpSec Monkey) #3

Thanks. sometimes its just another set of eyes to make stuff work right.


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.