How to get input to logstash from kafka consumer instead of kafka bootstrap server?

Elastic Stack Logstash
1

Hi, my pipeline is

producer-->kafka-->consumer-->logstash-->ES-->Kibana

here is my config used to get input from kafka
input
{
kafka
{
codec => json
bootstrap_servers => "10.24.13.13:9092"
topics => ["topic_dmesg","topic_syslog"]
}
}

Here i am getting input for logstash wahtever producer is sent,
But i dont want to get it as it is,
need to aggregate logs using consumer and send after aggregation of logs logstash have to read it from kafka consumer which are aggregated logs.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.