Logstash stopping without any error

Elastic Stack Logstash
1

Hello,

I have two logstash pipelines (in docker containers) running with a jdbc input and elastic output. Both pipelines are set to run with a schedule every 1 minute.

My problem is that sometimes the pipelines suddenly stop executing until I restart them. The last logs that I have in both pipelines are INFO with the query that jdbc executed.

Note the containers stay up and the logstash piepelines are running, simply they don't run when scheduled.

Can you help me find why the pipelines stop and how to fix this? Is there any alarmistic that can notify me if they stop?

Thanks in advance.

2

If you're not getting enough information in the logs, you can set the default log level to debug for example which will tell you a whole lot more. You can do that in your logstash.yml.

3

Update.
After enabling debug the only thing i have in logs is :

[2019-10-17T08:24:56,755][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:24:57,116][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:24:59,564][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2019-10-17T08:24:59,564][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2019-10-17T08:25:01,755][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:25:02,116][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:25:04,565][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2019-10-17T08:25:04,565][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2019-10-17T08:25:05,555][DEBUG][logstash.inputs.metrics ] Metrics input: received a new snapshot {:created_at=>2019-10-17 08:25:05 UTC, :snapshot=>#LogStash::Instrument::Snapshot:0x5ceb3327}
[2019-10-17T08:25:06,755][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:25:07,116][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:25:09,568][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2019-10-17T08:25:09,568][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2019-10-17T08:25:11,755][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2019-10-17T08:25:12,116][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.

repeated over and over again

4

Pipeline keeps stoping every couple of hours while showing the same Debug output. Only workaround is to restart.

1 Like
5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.