Log stash Installation

Elastic Stack Logstash
1

Hi,
I have installed logstash in my machine and I am getting below mentioned error while installing.Kindly help me.

[2018-04-19T23:49:11,825][INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"C:/Users/518785/ELK/logstash-6.2.3/bin/logstash-simple.conf"}
[2018-04-19T23:49:11,825][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
[2018-04-19T23:49:12,257][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

2

What do you need help with exactly?

3

It looks like you have no configuration files in the directory which you have configured for logstash. Logstash dont know what to do with your data.

4

Polter thanks for the reply!!
I have both pipeline/logstash YML files in config folder.

5

Hey @manojbhupatiraju,

Can you post your config files here, perhaps your config files are missing anything. What is your path where you store your config files ? Do you set a custom directory in the settings?

And please check that logstash can read the files (or have the permissions to read it).

Best regards
Robert

6

Logstash%20install
Logstash install.PNG1107×513 25.7 KB

7

Please test the following, execute this in your command line:

C:\\your_path_to_LOGSTASH_bat -f C:\\yourPathTOyourLogStashConf

replace your_path_to_LOGSTASH_bat to the path where your logstash.bat is, and replace yourPathTOyourLogStashConf with the path to your logstash.conf which has the input, filter and output sections.

If there are any errors, please post them here.

8

Polter I have executed the path and getting the same error. Please check.

C:\Users\518785\ELK\logstash-6.2.3\bin>logstash -f logstash-conf
Sending Logstash's logs to C:/Users/518785/ELK/logstash-6.2.3/logs which is now configured via log4j2.properties
[2018-04-22T22:16:23,051][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/fb_apache/configuration"}
[2018-04-22T22:16:23,098][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/netflow/configuration"}
[2018-04-22T22:16:23,332][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-04-22T22:16:23,943][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"6.2.3"}
[2018-04-22T22:16:24,068][INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"C:/Users/518785/ELK/logstash-6.2.3/bin/logstash-conf"}
[2018-04-22T22:16:24,099][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
[2018-04-22T22:16:24,545][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

9

Hey @manojbhupatiraju,

please retry it with a full qualified path to your config file.

And please try the -t flag in your startup command to test and exit (paste your output here)

Best regards,
Robert

10

Hi Polter,

I executed the command and I am getting pipeline file is empty. not sure why .Please suggest.

C:\Users\518785\ELK\logstash-6.2.3\bin>logstash -t logstash-conf
Sending Logstash's logs to C:/Users/518785/ELK/logstash-6.2.3/logs which is now configured via log4j2.properties
[2018-04-23T22:42:10,040][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/fb_apache/configuration"}
[2018-04-23T22:42:10,071][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/netflow/configuration"}
ERROR: Pipelines YAML file is empty. Location: C:/Users/518785/ELK/logstash-6.2.3/config/pipelines.yml
usage:
bin/logstash -f CONFIG_PATH [-t] [-r] [] [-w COUNT] [-l LOG]
bin/logstash --modules MODULE_NAME [-M "MODULE_NAME.var.PLUGIN_TYPE.PLUGIN_NAME.VARIABLE_NAME=VALUE"] [-t] [-w COUNT] [-l LOG]
bin/logstash -e CONFIG_STR [-t] [--log.level fatal|error|warn|info|debug|trace] [-w COUNT] [-l LOG]
bin/logstash -i SHELL [--log.level fatal|error|warn|info|debug|trace]
bin/logstash -V [--log.level fatal|error|warn|info|debug|trace]
bin/logstash --help
[2018-04-23T22:42:10,337][ERROR][org.logstash.Logstash ] java.lang.IllegalStateException: org.jruby.exceptions.RaiseException: (SystemExit) exit

11

Hey @manojbhupatiraju,

First a full qualified path-name is for example C:\myElasticInstallation\logstash.config.
It's important that you write out the complete path name to link to your config.

Please check if your file existst, in your picture which you send above, I can not see a file which has the name logstash-conf.

And if you want to use the-t flag you must also write the flag -f C:\YourPathToYourConfig,
so the command must looks like this: logstash.bat -f C:\YourPathToYourConfig -t

Best regards,
Robert

12

logstash%20install1
logstash install1.PNG1096×499 25.9 KB

Polter I have logstash-simple.conf file in config folder.I have tested the command with correct path and getting java exception .Please advice on it.

C:\Users\518785\ELK\logstash-6.2.3\bin>logstash.bat -f C:\Users\518785\ELK\logstash-6.2.3\config -t
Sending Logstash's logs to C:/Users/518785/ELK/logstash-6.2.3/logs which is now configured via log4j2.properties
[2018-04-24T02:22:43,428][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/fb_apache/configuration"}
[2018-04-24T02:22:43,444][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"C:/Users/518785/ELK/logstash-6.2.3/modules/netflow/configuration"}
[2018-04-24T02:22:43,660][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-04-24T02:22:43,961][FATAL][logstash.runner ] The given configuration is invalid. Reason: Expected one of #, input, filter, output at line 6, column 1 (byte 132) after ## JVM configuration

Xms represents the initial size of total heap space

Xmx represents the maximum size of total heap space

[2018-04-24T02:22:43,961][ERROR][org.logstash.Logstash ] java.lang.IllegalStateException: org.jruby.exceptions.RaiseException: (SystemExit) exit

13

Hey @manojbhupatiraju,
Please also write the file name behind your path, like this:
logstash.bat -f C:\Users\518785\ELK\logstash-6.2.3\config\logstash-simple.conf -t

Best regards,
Robert

14

Polter,
I have re installed (logstash-6.2.4)tested it but issue is same.
C:\Users\518785\ELK\logstash-6.2.4\bin>logstash.bat -f C:\Users\518785\ELK\logstash-6.2.4\config\logstash-simple.conf -t
Sending Logstash's logs to C:/Users/518785/ELK/logstash-6.2.4/logs which is now configured via log4j2.properties
[2018-04-26T01:46:03,268][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"C:/Users/518785/ELK/logstash-6.2.4/modules/fb_apache/configuration"}
[2018-04-26T01:46:03,286][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"C:/Users/518785/ELK/logstash-6.2.4/modules/netflow/configuration"}
[2018-04-26T01:46:03,503][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-04-26T01:46:03,576][INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"C:/Users/518785/ELK/logstash-6.2.4/config/logstash-simple.conf"}
[2018-04-26T01:46:03,591][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
Configuration OK
[2018-04-26T01:46:03,591][INFO ][logstash.runner ] Using config.test_and_exit mode. Config Validation Result: OK. Exiting Logstash

C:\Users\518785\ELK\logstash-6.2.4\bin>logstash.bat -f C:\Users\518785\ELK\logstash-6.2.4\config\logstash-simple.conf
Sending Logstash's logs to C:/Users/518785/ELK/logstash-6.2.4/logs which is now configured via log4j2.properties
[2018-04-26T01:47:06,113][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"C:/Users/518785/ELK/logstash-6.2.4/modules/fb_apache/configuration"}
[2018-04-26T01:47:06,138][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"C:/Users/518785/ELK/logstash-6.2.4/modules/netflow/configuration"}
[2018-04-26T01:47:06,343][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-04-26T01:47:06,559][INFO ][logstash.agent ] No persistent UUID file found. Generating new UUID {:uuid=>"bf8b377b-e78e-4aae-b4f2-45060e852c7e", :path=>"C:/Users/518785/ELK/logstash-6.2.4/data/uuid"}
[2018-04-26T01:47:07,245][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"6.2.4"}
[2018-04-26T01:47:07,414][INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"C:/Users/518785/ELK/logstash-6.2.4/config/logstash-simple.conf"}
[2018-04-26T01:47:07,442][ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
[2018-04-26T01:47:07,792][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

Regards,
Manoj.

15

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.