Hello,
We are facing a known issue with syslog
input of filebeat, And running our Elasticsearch cluster on CentOS Linux release 7.7.1908 (Core)
VM environment.
We are working with Cisco ASA and FTD firewall logs, But on filebeat journalctl
getting following error messages:
Dec 17 19:11:03 ELKFWLOGGING filebeat[8010]: 2019-12-17T19:11:03.214+0530 ERROR [syslog] syslog/input.go:134 can't parse event as syslog rfc3164 {"message": "<166>Dec 17 2019 19:11:03 10.1.3.4 : %ASA-6-302016: Teardown UDP connection 3187545438 for XXXXX:1.2.3.4/12345 to XXXXX:5.6.7.8/12 duration 0:00:00 bytes 56\n"}
Dec 17 19:11:03 ELKFWLOGGING filebeat[8010]: 2019-12-17T19:11:03.215+0530 ERROR [syslog] syslog/input.go:134 can't parse event as syslog rfc3164 {"message": "<166>Dec 17 2019 19:11:03 10.1.3.4 : %ASA-6-302015: Built inbound UDP connection 3187545439 for XXXXX:1.2.3.4/12398 1.2.3.4/12398) to XXXXX:5.6.7.8/90 (5.6.7.8/90)\n"}
My Filebeat file configuration is:
filebeat.inputs:
- type: syslog
protocol.udp:
host: "0.0.0.0:9001"
filebeat.config.modules:
path: ${path.config}/modules.d/*.yml
setup.template.settings:
index.number_of_shards: 1
index.codec: best_compression
#_source.enabled: false
setup.kibana:
host: "kibana.nw-elastic.dev.com:5601"
output.elasticsearch:
hosts: ["n1.nw-elastic.dev.com:9200"]
processors:
- add_host_metadata: ~
- add_cloud_metadata: ~
- add_docker_metadata: ~
- add_kubernetes_metadata: ~
The Cisco module config file at /etc/filebeat/modules.d/cisco.yml
configuration is:
- module: cisco
asa:
enabled: true
var.input: syslog
var.syslog_host: 0.0.0.0
var.syslog_port: 9001
var.log_level: 6
ftd:
enabled: true
#var.input: syslog
#var.syslog_host: localhost
#var.syslog_port: 9003
#var.log_level: 7
ios:
enabled: true
#var.input: syslog
#var.syslog_host: localhost
#var.syslog_port: 9002
#var.paths:
We are receiving logs at elasticsearch end but without parsing!
We've tested the cluster with both Version 7.4.2 and the latest 7.5.0, But still don't found any working solution suggested on discuss, github, etc. forums about the subjected issue.
Any help will be much appreciated
Thanks