We are collection logs from different kafka topics which are been created dynamically. The common pattern of the topic naming is application_name-log_type-logs. We have also some important topics too like qafilebeat, prfilebeat. How can we combine topics and topics_pattern options in logstash? Here is our current configuration
input{
kafka
{
bootstrap_servers => ["kafka1:9092"]
topics => ["logstash", "qafilebeat", "prfilebeat", "application1-error-logs", "application1-redirect-logs"]
auto_offset_reset => latest
decorate_events => true
group_id => "logstash_indexer"
}
}