Logtrail performance

Dawood · April 1, 2020, 7:20am

I have a question regarding Logtrail plugin in kibana. I am sending structured data from python using AsynchronousLogstashHandler:
handler = AsynchronousLogstashHandler(host=self.logstash_host, port=5045, database_path=None, transport='logstash_async.transport.UdpTransport')
handler.setFormatter(LogstashFormatter(tags=self.extra, extra=self.extra))
handler.setLevel(logging.NOTSET)
self.addHandler(handler)

logstash conf file configured correctly in rancher and logtrail json is the same as in github:

github.com

sivasamyk/logtrail/blob/master/logtrail.json

{
  "version" : 2,
  "index_patterns" : [
    {      
      "es": {
        "default_index": "kibana_sample_data_logs"
      },
      "tail_interval_in_seconds": 10,
      "es_index_time_offset_in_seconds": 0,
      "display_timezone": "local",
      "display_timestamp_format": "MMM DD HH:mm:ss",
      "max_buckets": 500,
      "default_time_range_in_days" : 0,
      "max_hosts": 100,
      "max_events_to_keep_in_viewer": 5000,
      "default_search": "",
      "fields" : {
        "mapping" : {
            "timestamp" : "@timestamp",
            "hostname" : "host",

This file has been truncated. show original

I can see the messages in a good format,However, they displayed as a bulk and not similar as an output of the console ( Not exactly real time) . My question is : Is there something should i configured maybe in the index, kibana, or logstash that can change the behaviour ?

Thanks,
Dawood

weltenwort · April 1, 2020, 9:11am

Hi @Dawood,

I can't offer advice about the logtrail plugin, because it is a third-party community plugin, but I'd like to point out that Kibana now features a built-in Logs UI. It's designed to work with all ECS-compatible log sources and actively being developed by a dedicated team.

The logtrail plugin doesn't mention an official support channel in their documentation, but maybe their issue tracker is a good starting point.

Dawood · April 1, 2020, 11:35am

Thank you. i will try to use Logs UI instead.

system · April 29, 2020, 11:36am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.