Want to send my original log for CPU usage to elasticsearch via logstash.
- Here is the log file
pasth:/opt/dev/resource/cpu/log
file name:result.log
06/14/2020:22:30:02,41
2.logstash input file
input {
file {
path => "/opt/dev/resource/cpu/log/result.log"
start_position => beginning
}
}
filter {
grok {
match => [
"message" => "%{timestamp}",
"message" => "${CPU}"
}
date {
match => [ "timestamp" , "dd/MMM/yyyy HH:mm:ss" ]
}
mutate {
replace => { "type" => "cpu" }
}
}
output {
elasticsearch {
hosts => ["172.17.10.204:9200"]
index => "CPU"
}
}
- Execute log for logstash
$ sudo /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/apache-access_log.conf
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.headius.backport9.modules.Modules (file:/usr/share/logstash/logstash-core/lib/jars/jruby-complete-9.2.7.0.jar) to field java.io.FileDescriptor.fd
WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults
Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console
[WARN ] 2020-06-14 22:40:09.289 [LogStash::Runner] multilocal - Ignoring the 'pipelines.yml' file because modules or command line options are specified
[INFO ] 2020-06-14 22:40:09.295 [LogStash::Runner] runner - Starting Logstash {"logstash.version"=>"6.8.10"}
[ERROR] 2020-06-14 22:40:09.937 [Converge PipelineAction::Create] agent - Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of #, {, ,, ] at line 10, column 19 (byte 160) after filter {\n grok {\n match => [\n "message" ", :backtrace=>["/usr/share/logstash/logstash-core/lib/logstash/compiler.rb:41:incompile_imperative'", "/usr/share/logstash/logstash-core/lib/logstash/compiler.rb:49:in
compile_graph'", "/usr/share/logstash/logstash-core/lib/logstash/compiler.rb:11:inblock in compile_sources'", "org/jruby/RubyArray.java:2577:in
map'", "/usr/share/logstash/logstash-core/lib/logstash/compiler.rb:10:incompile_sources'", "org/logstash/execution/AbstractPipelineExt.java:151:in
initialize'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:22:ininitialize'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:90:in
initialize'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:43:inblock in execute'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:96:in
block in exclusive'", "org/jruby/ext/thread/Mutex.java:165:insynchronize'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:96:in
exclusive'", "/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:39:inexecute'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:334:in
block in converge_state'"]}
[INFO ] 2020-06-14 22:40:10.091 [Api Webserver] agent - Successfully started Logstash API endpoint {:port=>9600}
[INFO ] 2020-06-14 22:40:15.141 [LogStash::Runner] runner - Logstash shut down.
Please help me.