Good morning everyone. I am running a custom config from a class on Udemy for ElasticSearch, LogStash and Kibana.
For whatever reason I get errors and I cant get it to run. I have been trying over and over and over. Can someone please tell me what I am doing wrong.
Here is my config file.
input {
file {
path => "/Users/defensivethinking/search/data/cars.csv"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}
filter {
csv {
seperator => ","
columns => [ "maker", "model", "mileage", "manufacture_year", "engine_displacement", "engine_power", "body_type", "color_slug", "stk_year", "transmission", "door_count", "seat_count", "fuel_type", "date_created", "date_last_seen", "price_eur" ]
}
mutate {convert => ["mileage", "integer"] }
mutate {convert => ["price_eur", "float"] }
mutate {convert => ["engine_power", "integer"] }
mutate {convert => ["door_count", "integer"] }
mutate {convert => ["seat_count", "integer"] }
}
output {
elasticsearch {
hosts => "localhost:9200"
index => "cars"
document_type => "sold_cars"
}
stdout {}
}
I get the same error with or without the port number on localhost
Now when I go to run the config I get a error
Alexs-MacBook-Pro:logstash defensivethinking$ bin/logstash -f /Users/defensivethinking/search/data/logstash_cars.config
Sending Logstash's logs to /Users/defensivethinking/search/logstash/logs which is now configured via log4j2.properties
[2018-01-04T17:41:41,594][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"/Users/defensivethinking/search/logstash/modules/netflow/configuration"}
[2018-01-04T17:41:41,614][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"/Users/defensivethinking/search/logstash/modules/fb_apache/configuration"}
[2018-01-04T17:41:41,904][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-01-04T17:41:42,753][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"6.1.1"}
[2018-01-04T17:41:43,221][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2018-01-04T17:41:46,468][ERROR][logstash.filters.csv ] Unknown setting 'seperator' for csv
[2018-01-04T17:41:46,493][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Something is wrong with your configuration.", :backtrace=>["/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/config/mixin.rb:89:in `config_init'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/filters/base.rb:128:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/filter_delegator.rb:23:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/plugins/plugin_factory.rb:88:in `plugin'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:114:in `plugin'", "(eval):12:in `<eval>'", "org/jruby/RubyKernel.java:994:in `eval'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:86:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline.rb:171:in `initialize'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:40:in `execute'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:335:in `block in converge_state'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:141:in `with_pipelines'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:332:in `block in converge_state'", "org/jruby/RubyArray.java:1734:in `each'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:319:in `converge_state'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:166:in `block in converge_state_and_update'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:141:in `with_pipelines'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:164:in `converge_state_and_update'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/agent.rb:90:in `execute'", "/Users/defensivethinking/search/logstash/logstash-core/lib/logstash/runner.rb:343:in `block in execute'", "/Users/defensivethinking/search/logstash/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/task.rb:24:in `block in initialize'"]}
Any help would be great.