# TCP Input - restarting pipeline "stalled" indefinitely and will not shut down **URL:** \ **Category:** Logstash\ **Created:** [July 20, 2018, 7:02pm UTC](https://discuss.elastic.co/t/tcp-input-restarting-pipeline-stalled-indefinitely-and-will-not-shut-down/140955 "2018-07-20T19:02:28Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![Micah\_Hunsberger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/micah_hunsberger/32/147436_2.png) [@Micah\_Hunsberger](https://discuss.elastic.co/u/Micah_Hunsberger)\ **Post date:** [July 20, 2018, 7:02pm UTC](https://discuss.elastic.co/t/tcp-input-restarting-pipeline-stalled-indefinitely-and-will-not-shut-down/140955/1 "2018-07-20T19:02:28Z")
Using TCP input breaks shutdown/restart. the pipeline will not reload if the configuration changes. - Version: Logstash v6.3.0, logstash-input-tcp v5.0.9 - Operating System: Windows Server 2012 - Config File (if you have sensitive info, please remove it): ```auto input{ tcp{ port => 50000 } } filter { } output{ } ``` - Sample Data: none required - Steps to Reproduce: start the pipeline with tcp input, then make a change to the configuration file so the pipeline reloads - logstash-plain.log ```auto [2018-07-20T14:07:32,763][INFO][logstash.pipeline] Starting pipeline {:pipeline_id=>"health-check", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50} [2018-07-20T14:07:34,857][INFO][logstash.inputs.tcp] Starting tcp input listener {:address=>"0.0.0.0:50000", :ssl_enable=>"false"} [2018-07-20T14:07:39,435][INFO][logstash.pipeline] Pipeline started successfully {:pipeline_id=>"health-check", :thread=>"#"} [2018-07-20T14:08:13,573][INFO][logstash.pipelineaction.reload] Reloading pipeline {"pipeline.id"=>:"health-check"} [2018-07-20T14:08:18,698][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} [2018-07-20T14:08:18,714][ERROR][logstash.shutdownwatcher] The shutdown process appears to be stalled due to busy or blocked plugins. Check the logs for more information. [2018-07-20T14:08:23,672][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} [2018-07-20T14:08:28,662][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} ``` that [logstash.shutdownwatcher] event will repeat indefinitely until logstash is terminated. I let it go for 4 minutes ```auto [2018-07-20T14:11:53,672][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} [2018-07-20T14:11:58,669][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} [2018-07-20T14:12:03,666][WARN][logstash.shutdownwatcher] {"inflight_count"=>0, "stalling_thread_info"=>{"other"=>[{"thread_id"=>35, "name"=>"[health-check]"[...]/vendor/bundle/jruby/2.3.0/gems/logstash-input-tcp-5.0.9-java/lib/logstash/inputs/tcp.rb:180:in `close'"}, {"thread_id"=>31, "name"=>nil, "current_call"=>"[...]/logstash-core/lib/logstash/pipeline.rb:418:in `read_batch'"}]}} ``` Then when I shut down logstash, there is still a "java.exe" process that cannot be terminated through task manager. If I try to start logstash again, it will through an exception and not start: ```auto [2018-07-20T14:30:58,510][INFO][logstash.configmanagement.elasticsearchsource] Configuration Management License OK [2018-07-20T14:30:58,635][FATAL][logstash.runner] Logstash could not be started because there is already another instance using the configured data directory. If you wish to run multiple instances, you must change the "path.data" setting. [2018-07-20T14:30:58,650][ERROR][org.logstash.Logstash] java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit ``` ---
**Author:** ![yaauie](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yaauie/32/23363_2.png) [@yaauie](https://discuss.elastic.co/u/yaauie)\ **Post date:** [July 20, 2018, 8:22pm UTC](https://discuss.elastic.co/t/tcp-input-restarting-pipeline-stalled-indefinitely-and-will-not-shut-down/140955/2 "2018-07-20T20:22:44Z")
Thanks for reporting. We'll follow up on the issue you filed [logstash-plugins/logstash-input-tcp#119](https://github.com/logstash-plugins/logstash-input-tcp/issues/119). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 17, 2018, 8:22pm UTC](https://discuss.elastic.co/t/tcp-input-restarting-pipeline-stalled-indefinitely-and-will-not-shut-down/140955/3 "2018-08-17T20:22:47Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.