I have two different logs format at input so I want to use multiple filebeat yml files and those pointing out to different logstash port
my logstash configuration is based on these inputs
filebeat1.yml
filebeat.inputs:
- type: log
enabled: true
paths:
- firstPath\*.log
file_identity.inode_marker.path: /logs/.filebeat-marker
multiline.pattern: '^[0-9]{4}-[0-9]{2}-[0-9]{2}'
multiline.negate: true
multiline.match: after
output.logstash:
hosts: ["localhost:5044"]
filebeat1.yml
filebeat.inputs:
- type: log
enabled: true
paths:
- secondPath\*.log
file_identity.inode_marker.path: /logs/.filebeat-marker
output.logstash:
hosts: ["localhost:5045"]
Logstash
input{
beats {
port => 5044
type => "increament_events"
add_field => { "[@metadata][no_show]" => "elasticsearch_and_solr_id" }
}
beats {
port => 5045
type => "search_events"
add_field => { "[@metadata][no_show]" => "elasticsearch_and_solr_id" }
}
}
and filebeat configuration I tried but not got where to write that code
filebeat.config_dir: ${path.config}/conf/