Join two log files using aggregate filter of logstash to enter combined event in kibana

Elastic Stack Logstash
1

I have used the below aggregate plugin for logstash to join two log files: Log1: PAGE,PAGEDESCRIPTION

Log 2: PAGE,HTTPAGENT

I WANT THE FINAL OUTPUT in kibana as: PAGE,PAGEDESCRIPTION,HTTPAGENT. The aggregate plugin snippet i used in filter

aggregate {
       task_id => "%{PAGE}"
       code => "
         map['PAGE'] ||= event.get('PAGE')
         map['PAGEDESCRIPTION'] ||= event.get('PAGEDESCRIPTION')
         map['HTTPAGENT'] ||= event.get('HTTPAGENT')
         #event.cancel()
       "
       push_previous_map_as_event => true
       timeout => 3

     }

But aggregate is not pushing the event to kibana , output in logstash conf file is as below:

output {

    elasticsearch {
        hosts => ["10.0.62.184:9200"]
        index => "%{[@metadata][beat]}-%{+YYYY.MM.dd}"

        #document_id => "%{PAGE}"
        template_overwrite => true
    }
}

May i know what mistake i am doing or am i missing anything here

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.