Hello,
I am using Logstash version 6.8.3. Recently I face issue with memory in logstash in the pipeline for beat tcp input. In the log I have below error
"Caused by: java.lang.IndexOutOfBoundsException: writerIndex(2147483437) + minWritableBytes(512) exceeds maxCapacity(2147483647): PooledUnsafeDirectByteBuf(ridx: 0, widx: 2147483437, cap: 2147483647)
Suppressed: java.lang.IndexOutOfBoundsException: writerIndex(2147483437) + minWritableBytes(512) exceeds maxCapacity(2147483647): PooledUnsafeDirectByteBuf(ridx: 0, widx: 2147483437, cap: 2147483647)"
After 1 hour the memory reaches to around 30 GB and the server memory reaches 100% and Logstash gets hung. I am using Heap size as 16 GB. There is a load balancer above the Logstash machines. I am using in memory queue wiith batch.size as 500 and 5 workers. The issue suddenly stops happening for 4-5 days and then again the same issue starts and keeps happening for dayss.