I looked at the filebeat logs, and found that periodically, for a minute, no packets were dropped. Usually, I would see
input.netflow.packets.dropped: 20000
input.netflow.packets.received: 8000
But there are times where there would be no dropped packets and the number of received packets would be much higher. This usually occurs when memstats.gc_next and memstats.memory_alloc are the lowest compared to a few minutes before and after.
Is my performance affected by memory? I don't quite understand the explanation of beat.memstats.gc_next in this post, but my memstats.memory_alloc is always lesser than memstats.gc_next.
I have set the JVM heap size of my ES to 64GB, where the server has 755GB of RAM:
-Xms64g
-Xmx64g
Should I decrease this to 32GB?