My filebeat is reading the log file but it 's not sending anything to logstash
Here are my filebeats.yml:
filebeat.inputs:
# Each - is an input. Most options can be set at the input level, so
# you can use different inputs for various configurations.
# Below are the input specific configurations.
- type: log
# Change to true to enable this input configuration.
enabled: true
# Paths that should be crawled and fetched. Glob based paths.
paths:
- C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log
filebeat.config.modules:
# Glob pattern for configuration loading
path: ${path.config}/modules.d/*.yml
# Set to true to enable config reloading
reload.enabled: false
# Period on which files under path should be checked for changes
#reload.period: 10s
#==================== Elasticsearch template setting ==========================
setup.template.settings:
index.number_of_shards: 3
output.logstash:
# The Logstash hosts
hosts: ["localhost:5044"]
output.console:
pretty: true
And here the logs it's providing me:
2021-02-16T14:45:08.181+0100 DEBUG [input] input/input.go:139 Run input
2021-02-16T14:45:08.321+0100 DEBUG [input] log/input.go:205 Start next scan
2021-02-16T14:45:08.339+0100 DEBUG [input] log/input.go:439 Check file for harvesting: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log
2021-02-16T14:45:08.342+0100 DEBUG [input] log/input.go:530 Update existing file for harvesting: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log, offset: 0
2021-02-16T14:45:08.363+0100 DEBUG [input] log/input.go:582 Harvester for file is still running: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log
2021-02-16T14:45:08.374+0100 DEBUG [input] log/input.go:226 input states cleaned up. Before: 1, After: 1, Pending: 0
2021-02-16T14:45:11.981+0100 DEBUG [harvester] log/log.go:107 End of file reached: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log; Backoff now.
2021-02-16T14:45:18.498+0100 DEBUG [input] input/input.go:139 Run input
2021-02-16T14:45:18.518+0100 DEBUG [input] log/input.go:205 Start next scan
2021-02-16T14:45:18.639+0100 DEBUG [input] log/input.go:439 Check file for harvesting: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log
2021-02-16T14:45:18.639+0100 DEBUG [input] log/input.go:530 Update existing file for harvesting: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log, offset: 0
2021-02-16T14:45:18.639+0100 DEBUG [input] log/input.go:582 Harvester for file is still running: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log
2021-02-16T14:45:18.639+0100 DEBUG [input] log/input.go:226 input states cleaned up. Before: 1, After: 1, Pending: 0
2021-02-16T14:45:22.322+0100 DEBUG [harvester] log/log.go:107 End of file reached: C:\elasticstack\filebeat-7.10.2-windows-x86_64\filebeat-7.10.2-windows-x86_64\logs\test.log; Backoff now.
2021-02-16T14:45:26.701+0100 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":125},"total":{"ticks":250,"time":{"ms":16},"value":250},"user":{"ticks":125,"time":{"ms":16}}},"handles":{"open":199},"info":{"ephemeral_id":"65318393-d82f-4e79-80a1-026b7282beb8","uptime":{"ms":60286}},"memstats":{"gc_next":17307248,"memory_alloc":9931160,"memory_total":44680864,"rss":8192},"runtime":{"goroutines":31}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":1}}}}}
And here is my logstash.conf (Simple one just for test)
input {
beats { port => 5044 }
}
output {
elasticsearch {
hosts => ["localhost:9200"]
}
stdout { codec => rubydebug }
}
