[ERROR][logstash.config.sourceloader] No configuration found in the configured sources

Elastic Stack Logstash
1

Hello,

I am very new to ELK, I am trying to setup ELK (7.11.2) in my local windows 10 laptop.
I am able to successfully run Elasticsearch and Kibana but I have issue with Logstash.

I tried to figure out this issue by going through other posts bit its not working.

My pipeline.yml is :-

  • pipeline.id: test
    pipeline.workers: 1
    path.config: "c:/ELK/hellologstash.conf"
    =======================================

My logstash.yml is :-

pipeline.ordered: auto
log.level: debug
path.logs: "C:/ELK/intralogs/"

My configuration file is:-

input {
file {
path => "C:/ELK/intralogs/intranet-*.log"
start_position => "beginning"
}
}

output {
elasticsearch {
hosts => ["localhost:9200"]
index==> "indexforlogs"
}
stdout { codec => rubydebug }
}

Error while starting logstash is below :-

PS C:\ELK\logstash-7.11.2-windows-x86_64\logstash-7.11.2\bin> logstash -f hellologstash.conf Using JAVA_HOME defined java: C:\Program Files\Java\jdk1.8.0_281
WARNING, using JAVA_HOME while Logstash distribution comes with a bundled JDK
Sending Logstash logs to C:/ELK/intralogs/ which is now configured via log4j2.properties
[2021-03-19T11:39:21,878][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.11.2", "jruby.version"=>"jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc Java HotSpot(TM) 64-Bit Server VM 25.281-b09 on 1.8.0_281-b09 +indy +jit [mswin32-x86_64]"}
[2021-03-19T11:39:21,979][DEBUG][logstash.modules.scaffold] Found module {:module_name=>"fb_apache", :directory=>"C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/modules/fb_apache/configuration"}
[2021-03-19T11:39:21,979][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"fb_apache", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x47c9b8ee @directory="C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/modules/fb_apache/configuration", @module_name="fb_apache", @kibana_version_parts=["6", "0", "0"]>}
[2021-03-19T11:39:21,987][DEBUG][logstash.modules.scaffold] Found module {:module_name=>"netflow", :directory=>"C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/modules/netflow/configuration"}
[2021-03-19T11:39:21,989][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"netflow", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x69f4143 @directory="C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/modules/netflow/configuration", @module_name="netflow", @kibana_version_parts=["6", "0", "0"]>}
[2021-03-19T11:39:22,068][DEBUG][logstash.runner ] -------- Logstash Settings (* means modified) ---------
[2021-03-19T11:39:22,070][DEBUG][logstash.runner ] node.name: "PORT-145"
[2021-03-19T11:39:22,070][DEBUG][logstash.runner ] *path.config: "hellologstash.conf"
[2021-03-19T11:39:22,070][DEBUG][logstash.runner ] path.data: "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/data"
[2021-03-19T11:39:22,078][DEBUG][logstash.runner ] modules.cli: <Java::OrgLogstashUtil::ModulesSettingArray:1 >
[2021-03-19T11:39:22,080][DEBUG][logstash.runner ] modules:
[2021-03-19T11:39:22,080][DEBUG][logstash.runner ] modules_list:
[2021-03-19T11:39:22,080][DEBUG][logstash.runner ] modules_variable_list:
[2021-03-19T11:39:22,080][DEBUG][logstash.runner ] modules_setup: false
[2021-03-19T11:39:22,088][DEBUG][logstash.runner ] config.test_and_exit: false
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] config.reload.automatic: false
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] config.reload.interval: #Java::OrgLogstashUtil::TimeValue:0xc370bb5
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] config.support_escapes: false
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] config.field_reference.parser: "STRICT"
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] metric.collect: true
[2021-03-19T11:39:22,090][DEBUG][logstash.runner ] pipeline.id: "main"
[2021-03-19T11:39:22,098][DEBUG][logstash.runner ] pipeline.system: false
[2021-03-19T11:39:22,098][DEBUG][logstash.runner ] pipeline.workers: 8
[2021-03-19T11:39:22,100][DEBUG][logstash.runner ] pipeline.batch.size: 125
[2021-03-19T11:39:22,100][DEBUG][logstash.runner ] pipeline.batch.delay: 50
[2021-03-19T11:39:22,100][DEBUG][logstash.runner ] pipeline.unsafe_shutdown: false
[2021-03-19T11:39:22,100][DEBUG][logstash.runner ] pipeline.java_execution: true
[2021-03-19T11:39:22,100][DEBUG][logstash.runner ] pipeline.reloadable: true
[2021-03-19T11:39:22,108][DEBUG][logstash.runner ] pipeline.plugin_classloaders: false
[2021-03-19T11:39:22,110][DEBUG][logstash.runner ] pipeline.separate_logs: false
[2021-03-19T11:39:22,110][DEBUG][logstash.runner ] pipeline.ordered: "auto"
[2021-03-19T11:39:22,110][DEBUG][logstash.runner ] pipeline.ecs_compatibility: "disabled"
[2021-03-19T11:39:22,110][DEBUG][logstash.runner ] path.plugins:
[2021-03-19T11:39:22,110][DEBUG][logstash.runner ] config.debug: false
[2021-03-19T11:39:22,118][DEBUG][logstash.runner ] *log.level: "debug" (default: "info")
[2021-03-19T11:39:22,120][DEBUG][logstash.runner ] version: false
[2021-03-19T11:39:22,120][DEBUG][logstash.runner ] help: false
[2021-03-19T11:39:22,120][DEBUG][logstash.runner ] log.format: "plain"
[2021-03-19T11:39:22,120][DEBUG][logstash.runner ] http.enabled: true
[2021-03-19T11:39:22,120][DEBUG][logstash.runner ] http.host: "127.0.0.1"
[2021-03-19T11:39:22,128][DEBUG][logstash.runner ] http.port: 9600..9700
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] http.environment: "production"
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] queue.type: "memory"
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] queue.drain: false
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] queue.page_capacity: 67108864
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] queue.max_bytes: 1073741824
[2021-03-19T11:39:22,130][DEBUG][logstash.runner ] queue.max_events: 0
[2021-03-19T11:39:22,138][DEBUG][logstash.runner ] queue.checkpoint.acks: 1024
[2021-03-19T11:39:22,140][DEBUG][logstash.runner ] queue.checkpoint.writes: 1024
[2021-03-19T11:39:22,140][DEBUG][logstash.runner ] queue.checkpoint.interval: 1000
[2021-03-19T11:39:22,140][DEBUG][logstash.runner ] queue.checkpoint.retry: false
[2021-03-19T11:39:22,140][DEBUG][logstash.runner ] dead_letter_queue.enable: false
[2021-03-19T11:39:22,140][DEBUG][logstash.runner ] dead_letter_queue.max_bytes: 1073741824
[2021-03-19T11:39:22,220][DEBUG][logstash.runner ] --------------- Logstash Settings -------------------
[2021-03-19T11:39:22,261][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2021-03-19T11:39:22,321][DEBUG][logstash.agent ] Setting up metric collection
[2021-03-19T11:39:22,382][DEBUG][logstash.instrument.periodicpoller.os] Starting {:polling_interval=>5, :polling_timeout=>120}
[2021-03-19T11:39:22,400][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2021-03-19T11:39:22,542][DEBUG][logstash.instrument.periodicpoller.jvm] Starting {:polling_interval=>5, :polling_timeout=>120}
[2021-03-19T11:39:22,671][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2021-03-19T11:39:22,671][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2021-03-19T11:39:22,702][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
[2021-03-19T11:39:22,733][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
[2021-03-19T11:39:22,802][DEBUG][logstash.agent ] Starting agent
[2021-03-19T11:39:22,949][DEBUG][logstash.config.source.local.configpathloader] Skipping the following files while reading config since they don't match the specified glob pattern {:files=>["C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/benchmark.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/benchmark.sh", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/cpdump", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/dependencies-report", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/ingest-convert.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/ingest-convert.sh", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash-keystore", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash-keystore.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash-plugin", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash-plugin.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/logstash.lib.sh", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/pqcheck", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/pqcheck.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/pqrepair", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/pqrepair.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/ruby", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/setup.bat", "C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/system-install"]}
[2021-03-19T11:39:22,965][INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"C:/ELK/logstash-7.11.2-windows-x86_64/logstash-7.11.2/bin/hellologstash.conf"}
[2021-03-19T11:39:22,971][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
[2021-03-19T11:39:23,023][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>0}
[2021-03-19T11:39:23,072][DEBUG][logstash.agent ] Starting puma
[2021-03-19T11:39:23,087][DEBUG][logstash.instrument.periodicpoller.os] Stopping
[2021-03-19T11:39:23,087][DEBUG][logstash.agent ] Trying to start WebServer {:port=>9600}
[2021-03-19T11:39:23,118][DEBUG][logstash.instrument.periodicpoller.jvm] Stopping
[2021-03-19T11:39:23,118][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Stopping
[2021-03-19T11:39:23,118][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Stopping
[2021-03-19T11:39:23,134][DEBUG][logstash.agent ] Shutting down all pipelines {:pipelines_count=>0}
[2021-03-19T11:39:23,134][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>0}
[2021-03-19T11:39:23,203][DEBUG][logstash.api.service ] [api-service] start
[2021-03-19T11:39:23,535][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2021-03-19T11:39:28,312][INFO ][logstash.runner ] Logstash shut down.
[2021-03-19T11:41:24,781][FATAL][org.logstash.Logstash ] Logstash stopped processing because of an error: (SystemExit) exit
org.jruby.exceptions.SystemExit: (SystemExit) exit
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:747) ~[jruby-complete-9.2.13.0.jar:?]
at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:710) ~[jruby-complete-9.2.13.0.jar:?]
at C_3a_.ELK.logstash_minus_7_dot_11_dot_2_minus_windows_minus_x86_64.logstash_minus_7_dot_11_dot_2.lib.bootstrap.environment.(C:\ELK\logstash-7.11.2-windows-x86_64\logstash-7.11.2\lib\bootstrap\environment.rb:89) ~[?:?]
PS C:\ELK\logstash-7.11.2-windows-x86_64\logstash-7.11.2\bin>

Can you please help me?

2

You are running logstash using logstash -f hellologstash.conf which tells it to look in the current directory for that file. That file either does not exist in that directory or is not readable.

3

Hello Badger.. Thanks for your prompt reply. Actually there were an extra = in my config file (index => "indexforlogs") . Now I am able to execute the logstash.

My another question is... I have some logs in C:\ELK\intralogs folder. If I keep adding new logs in this directory, will it pass to elasticsearch/kibana knowing that I already created Index patterns.?
Do I need to restart logstach? or do I need to do something else?
Thanks in advance for your answer.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.