Logstash-6.2.4-1 persisted queue hung again

Elastic Stack Logstash
1

Spent a couple hours looking through the forum. Lots of people talking about persisted queues not processing but have not seen any solutions to troubleshoot.

This seems to be a single file that needs to be looked at 55940 How can I fix that file and process the rest ?

[2018-04-24T17:34:03,691][DEBUG][org.logstash.ackedqueue.Queue] opening tail page: 55938, in: /opt/logstash/queue/main, with checkpoint: pageNum=55938, firstUnackedPageNum=0, firstUnackedSeqNum=1321359026, minSeqNum=1321359026, elementCount=23257, isFullyAcked=no
[2018-04-24T17:34:03,811][DEBUG][org.logstash.ackedqueue.Queue] opening tail page: 55939, in: /opt/logstash/queue/main, with checkpoint: pageNum=55939, firstUnackedPageNum=0, firstUnackedSeqNum=1321382283, minSeqNum=1321382283, elementCount=23530, isFullyAcked=no
[2018-04-24T17:34:03,847][DEBUG][logstash.instrument.periodicpoller.persistentqueue] e=nil, @value_is_set=false, @klass=Fixnum, @default=3000000000, @validator_proc=nil>, "config.support_escapes"=>#<LogStash::Setting::Boolean:0x402bfcec @name="config.support_escapes", @value=nil, @value_is_set=false, @klass=Object,
..........
:polling_interval=>5, :exception=>Concurrent::TimeoutError, :executed_at=>2018-04-24 17:34:03 -0400}
[2018-04-24T17:34:04,009][DEBUG][org.logstash.ackedqueue.Queue] opening tail page: 55941, in: /opt/logstash/queue/main, with checkpoint: pageNum=55941, firstUnackedPageNum=0, firstUnackedSeqNum=1321429580, minSeqNum=1321429580, elementCount=24623, isFullyAcked=no
[2018-04-24T17:34:04,110][DEBUG][org.logstash.ackedqueue.Queue] opening tail page: 55942, in: /opt/logstash/queue/main, with checkpoint: pageNum=55942, firstUnackedPageNum=0, firstUnackedSeqNum=1321454203, minSeqNum=1321454203, elementCount=24259, isFullyAcked=no

2

Tried just removing the checkpoint and page file.
"IOError", :message=>"java.nio.file.NoSuchFileException: /opt/logstash/queue/main/checkpoint.55940",

3

Corrupt PQ seems to be a theme in LS with still no tools of docs.
Is it recommended not use use PQ ?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.