Installation document for ELK 8.7

While trying to install the ELK 8.7 and its components such as file beat logstash kibana and Elasticsearch and trying to setup the ELK as below

Filebeat =====> Logstash ======> elastic =======>kibana keeping this workflow

but while trying to starting logstash getting errors as below please help me to fix the below errors

2023-07-04T21:50:36,662][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600, :ssl_enabled=>false}
[2023-07-04T21:50:36,700][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of [A-Za-z0-9_-], [ \t\r\n], "#", "=>" at line 6, column 15 (byte 75) after input\n{\nfile {\npath => "/logs/NETSRV91/*.log"\ntype =>"logs"\nstart_position", :backtrace=>["/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/compiler.rb:32:in `compile_imperative'", "org/logstash/execution/AbstractPipelineExt.java:239:in `initialize'", "org/logstash/execution/AbstractPipelineExt.java:173:in `initialize'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/java_pipeline.rb:48:in `initialize'", "org/jruby/RubyClass.java:911:in `new'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/pipeline_action/create.rb:50:in `execute'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/agent.rb:386:in `block in converge_state'"]}
[2023-07-04T21:50:36,713][INFO ][logstash.runner ] Logstash shut down.
[2023-07-04T21:50:36,715][FATAL][org.logstash.Logstash ] Logstash stopped processing because of an error: (SystemExit) exit
org.jruby.exceptions.SystemExit: (SystemExit) exit
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?]
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?]
at app.ELK_Binary.logstash_minus_8_dot_7_dot_1.lib.bootstrap.environment.(/app/ELK_Binary/logstash-8.7.1/lib/bootstrap/environment.rb:91) ~[?:?

	cktrace=>["/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/compiler.rb:32:in `compile_imperative'", "org/logstash/execution/AbstractPipelineExt.java:239:in `initialize'", "org/logstash/execution/AbstractPipelineExt.java:173:in `initialize'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/java_pipeline.rb:48:in `initialize'", "org/jruby/RubyClass.java:911:in `new'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/pipeline_action/create.rb:50:in `execute'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/agent.rb:386:in `block in converge_state'"]}

[2023-07-04T23:15:57,440][INFO ][logstash.runner ] Logstash shut down.
[2023-07-04T23:15:57,443][FATAL][org.logstash.Logstash ] Logstash stopped processing because of an error: (SystemExit) exit
org.jruby.exceptions.SystemExit: (SystemExit) exit
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?]
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?]
at app.ELK_Binary.logstash_minus_8_dot_7_dot_1.lib.bootstrap.environment.(/app/ELK_Binary/logstash-8.7.1/lib/bootstrap/environment.rb:91) ~[?:?]
Using bundled JDK: /app/ELK_Binary/logstash-8.7.1/jdk
Sending Logstash logs to /app/ELK_Binary/logstash-8.7.1/logs which is now configured via log4j2.properties
[2023-07-04T23:19:05,182][INFO ][logstash.runner ] Log4j configuration path used is: /app/ELK_Binary/logstash-8.7.1/config/log4j2.properties
[2023-07-04T23:19:05,186][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"8.7.1", "jruby.version"=>"jruby 9.3.10.0 (2.6.8) 2023-02-01 107b2e6697 OpenJDK 64-Bit Server VM 17.0.7+7 on 17.0.7+7 +indy +jit [x86_64-linux]"}
[2023-07-04T23:19:05,187][INFO ][logstash.runner ] JVM bootstrap flags: [-Xms1g, -Xmx1g, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djruby.compile.invokedynamic=true, -XX:+HeapDumpOnOutOfMemoryError, -Djava.security.egd=file:/dev/urandom, -Dlog4j2.isThreadContextMapInheritable=true, -Djruby.regexp.interruptible=true, -Djdk.io.File.enableADS=true, --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED, --add-opens=java.base/java.security=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.nio.channels=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.management/sun.management=ALL-UNNAMED]
[2023-07-04T23:19:05,324][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2023-07-04T23:19:05,788][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of [ \t\r\n], "#", "input", "filter", "output" at line 9, column 1 (byte 93) after ", :backtrace=>["/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/compiler.rb:32:in `compile_imperative'", "org/logstash/execution/AbstractPipelineExt.java:239:in `initialize'", "org/logstash/execution/AbstractPipelineExt.java:173:in `initialize'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/java_pipeline.rb:48:in `initialize'", "org/jruby/RubyClass.java:911:in `new'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/pipeline_action/create.rb:50:in `execute'", "/app/ELK_Binary/logstash-8.7.1/logstash-core/lib/logstash/agent.rb:386:in `block in converge_state'"]}
[2023-07-04T23:19:05,821][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600, :ssl_enabled=>false}
[2023-07-04T23:19:05,826][INFO ][logstash.runner ] Logstash shut down.
[2023-07-04T23:19:05,829][FATAL][org.logstash.Logstash ] Logstash stopped processing because of an error: (SystemExit) exit
org.jruby.exceptions.SystemExit: (SystemExit) exit
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?]
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?]
at app.ELK_Binary.logstash_minus_8_dot_7_dot_1.lib.bootstrap.environment.(/app/ELK_Binary/logstash-8.7.1/lib/bootstrap/environment.rb:91) ~[?:?]

Appreciate your timely response to fix the issue or any pointers to set above configuration on stand alone server is highly appreciated.

Regards,
Siva

Something is not OK in your conf file at line 6, should be:
start_position => beginning

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.