We currently use log4net that uses UDP to parse data over the network to logstash where we have recently found that it is silently dropping messages as the UDP appender cannot keep up. Can anyone advise if there are any alternatives to UDP like TCP that will allow us to parse messages more reliably. Adjusting the workers does not improve the stability of UDP
Write the log entries to disk and use Filebeat to ship them. Having appenders send logs directly over the network is inherently unreliable.
Thanks for the response.
We have a number of servers that currently have log4net that parses into logstash across the network using UDP which we have recently found that logstash cannot keep up after a while. Parsing to a file on the server than logstash reads from the file defeats the object. Is there another way? or how do others do it?
We have a number of servers that currently have log4net that parses into logstash across the network using UDP which we have recently found that logstash cannot keep up after a while. Parsing to a file on the server than logstash reads from the file defeats the object.
Which objective? My objectives are always a) reliable applications with b) reliable remote logging. I don't see how both those objectives can be met when logging directly over the network.
Is there another way? or how do others do it?
Most people make the applications log to disk and ship the logs asynchronously via e.g. Filebeat so I'm not advocating anything controversial.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.