Logstash stopped at the line pipeline main started

Elastic Stack Logstash
1

Hi .. I'm new to ELK
I'm trying to execute simple logstash (version: 2.3.2) command, but it has stopped working

Command:
D:\downloads\elk\logstash\bin>logstash -e 'input { stdin { } } output { stdout {
} }' --debug

output:

io/console not supported; tty will not be manipulated
Settings: Default pipeline workers: 4
Pipeline main started

with --debug:

←[36mPushing shutdown {:thread=>#<Thread:0x3d2775ee run>, :level=>:debug, :file=

"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/
lib/logstash/pipeline.rb", :line=>"395", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0xc6a972a {:level=>:debug, :fi
le=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-ja
va/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x5c002d80 {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x4eda90e4 {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x3d2775ee {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mclosing output delegator {:klass=>LogStash::Outputs::Stdout, :level=>:debug
, :file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3
.2-java/lib/logstash/output_delegator.rb", :line=>"137", :method=>"do_close"}←[0
m
←[36mclosing {:plugin=><LogStash::Outputs::Stdout codec=><LogStash::Codecs::Line
charset=>"UTF-8", delimiter=>"\n">, workers=>1>, :level=>:debug, :file=>"/downl
oads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logs
tash/plugin.rb", :line=>"35", :method=>"do_close"}←[0m
Pipeline main has been shutdown {:file=>"/downloads/elk/logstash/vendor/bundle/j
ruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/agent.rb", :line=>"465", :me
thod=>"start_pipeline"}

Could you please help me

2

I'm not sure what you expected. Logstash's stdin input is waiting for input and it doesn't seem like you're giving it anything.

3

Thank you..
but getting same problem with the following command

D:\downloads\elk\logstash\bin>logstash -f D:\downloads\elk\logstash\logstash.conf --debug

logstash.conf file contains the following lines

input{
file{
path => "D:/downloads/elk/logstash/catalina.2017-04-05.log"
start_position => beginning
type => "tomcat_log"
}
}

output{
stdout { }
}

output with --debug:

←[32mInput plugins stopped! Will shutdown filter/output workers. {:level=>:info,
:file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.
2-java/lib/logstash/pipeline.rb", :line=>"148", :method=>"run"}←[0m
←[36mPushing flush onto pipeline {:level=>:debug, :file=>"/downloads/elk/logstas
h/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/pipeline.rb
", :line=>"458", :method=>"flush"}←[0m
←[36mPushing shutdown {:thread=>#<Thread:0x613863cb run>, :level=>:debug, :file=

"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/
lib/logstash/pipeline.rb", :line=>"395", :method=>"shutdown_workers"}←[0m
←[36mPushing shutdown {:thread=>#<Thread:0x5a6652dc sleep>, :level=>:debug, :fil
e=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-jav
a/lib/logstash/pipeline.rb", :line=>"395", :method=>"shutdown_workers"}←[0m
←[36mPushing shutdown {:thread=>#<Thread:0x51f74be6 sleep>, :level=>:debug, :fil
e=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-jav
a/lib/logstash/pipeline.rb", :line=>"395", :method=>"shutdown_workers"}←[0m
←[36mPushing shutdown {:thread=>#<Thread:0x74c6cf71 dead>, :level=>:debug, :file
=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java
/lib/logstash/pipeline.rb", :line=>"395", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x613863cb {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x5a6652dc {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x51f74be6 {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mShutdown waiting for worker thread #Thread:0x74c6cf71 {:level=>:debug, :f
ile=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-j
ava/lib/logstash/pipeline.rb", :line=>"400", :method=>"shutdown_workers"}←[0m
←[36mclosing output delegator {:klass=>LogStash::Outputs::Stdout, :level=>:debug
, :file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3
.2-java/lib/logstash/output_delegator.rb", :line=>"137", :method=>"do_close"}←[0
m
←[36mclosing {:plugin=><LogStash::Outputs::Stdout codec=><LogStash::Codecs::Line
charset=>"UTF-8", delimiter=>"\n">, workers=>1>, :level=>:debug, :file=>"/downl
oads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logs
tash/plugin.rb", :line=>"35", :method=>"do_close"}←[0m
Pipeline main has been shutdown {:file=>"/downloads/elk/logstash/vendor/bundle/j
ruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/agent.rb", :line=>"465", :me
thod=>"start_pipeline"}

4

Logstash is probably tailing the file. Earlier log entries contain clues (you're only quoting the final parts where Logstash is shutting down, on your request I presume). You can delete the sincedb file or set the file input's sincedb_path option to "nul" to force it to read the input file from the top.

5

added the sincedb_path => "nul" in file.

getting the following output:

←[32mRegistering file input {:path=>["D:/downloads/elk/logstash/catalina.2017-01
-27.log"], :level=>:info, :file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.
9/gems/logstash-input-file-2.2.5/lib/logstash/inputs/file.rb", :line=>"171", :me
thod=>"register"}←[0m
←[36mPlugin not defined in namespace, checking for plugin file {:type=>"codec",
:name=>"line", :path=>"logstash/codecs/line", :level=>:debug, :file=>"/downloads
/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash
/plugin.rb", :line=>"76", :method=>"lookup"}←[0m
←[36m_globbed_files: D:/downloads/elk/logstash/catalina.2017-01-27.log: glob is:
["D:/downloads/elk/logstash/catalina.2017-01-27.log"] {:level=>:debug, :file=>"
/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/filewatch-0.8.1/lib/filewat
ch/watch.rb", :line=>"346", :method=>"_globbed_files"}←[0m
←[36m_discover_file: D:/downloads/elk/logstash/catalina.2017-01-27.log: new: D:/
downloads/elk/logstash/catalina.2017-01-27.log (exclude is []) {:level=>:debug,
:file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/filewatch-0.8.1/lib
/filewatch/watch.rb", :line=>"310", :method=>"_discover_file"}←[0m
←[36m_discover_file: D:/downloads/elk/logstash/catalina.2017-01-27.log: skipping
because it was last modified more than 86400.0 seconds ago {:level=>:debug, :fi
le=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/filewatch-0.8.1/lib/fi
lewatch/watch.rb", :line=>"330", :method=>"_discover_file"}←[0m
←[36mconfig LogStash::Codecs::Line/@charset = "UTF-8" {:level=>:debug, :file=>"/
downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib
/logstash/config/mixin.rb", :line=>"153", :method=>"config_init"}←[0m
←[36mconfig LogStash::Codecs::Line/@delimiter = "\n" {:level=>:debug, :file=>"/d
ownloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/
logstash/config/mixin.rb", :line=>"153", :method=>"config_init"}←[0m
←[36mconfig LogStash::Outputs::Stdout/@codec = <LogStash::Codecs::Line charset=>
"UTF-8", delimiter=>"\n"> {:level=>:debug, :file=>"/downloads/elk/logstash/vendo
r/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/config/mixin.rb",
:line=>"153", :method=>"config_init"}←[0m
←[36mconfig LogStash::Outputs::Stdout/@workers = 1 {:level=>:debug, :file=>"/dow
nloads/elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/lo
gstash/config/mixin.rb", :line=>"153", :method=>"config_init"}←[0m
←[36mWill start workers for output {:worker_count=>1, :class=>LogStash::Outputs:
:Stdout, :level=>:debug, :file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9
/gems/logstash-core-2.3.2-java/lib/logstash/output_delegator.rb", :line=>"77", :
method=>"register"}←[0m
←[32mStarting pipeline {:id=>"main", :pipeline_workers=>4, :batch_size=>125, :ba
tch_delay=>5, :max_inflight=>500, :level=>:info, :file=>"/downloads/elk/logstash
/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/pipeline.rb"
, :line=>"188", :method=>"start_workers"}←[0m
Pipeline main started {:file=>"/downloads/elk/logstash/vendor/bundle/jruby/1.9/g
ems/logstash-core-2.3.2-java/lib/logstash/agent.rb", :line=>"465", :method=>"sta
rt_pipeline"}
←[36mPushing flush onto pipeline {:level=>:debug, :file=>"/downloads/elk/logstas
h/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/pipeline.rb
", :line=>"458", :method=>"flush"}←[0m
←[36m_globbed_files: D:/downloads/elk/logstash/catalina.2017-01-27.log: glob is:
["D:/downloads/elk/logstash/catalina.2017-01-27.log"] {:level=>:debug, :file=>"
/downloads/elk/logstash/vendor/bundle/jruby/1.9/gems/filewatch-0.8.1/lib/filewat
ch/watch.rb", :line=>"346", :method=>"_globbed_files"}←[0m
←[36mPushing flush onto pipeline {:level=>:debug, :file=>"/downloads/elk/logstas
h/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/pipeline.rb
", :line=>"458", :method=>"flush"}←[0m
←[36mPushing flush onto pipeline {:level=>:debug, :file=>"/downloads/elk/logstas
h/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.2-java/lib/logstash/pipeline.rb
", :line=>"458", :method=>"flush"}←[0m

6

skipping because it was last modified more than 86400.0 seconds ago

You need to adjust the file input's ignore_older option.

7

Thank you.. It's working now

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.