Filebeat for redis slowlog

Elastic Stack Beats
1

Hi Friends,
Need help with my configuration. I am trying to see if i can configure filebeat to ingest redis slow logs into my elasticsearch cluster. before that want to see if i get the events listed to console

here is my snippet from filebeat.yml

output.console:
  pretty: true

modules.d/redis.yml

- module: redis
  log:
    enabled: false
    var.paths: ["/path/to/log/redis/redis-server.log*"]
  # Slow logs, retrieved via the Redis API (SLOWLOG)
  slowlog:
    enabled: true
    # The Redis hosts to connect to.
    var.hosts: ["elasticache1.xyxxnd.ng.0001.usw2.cache.amazonaws.com:6379"]

my output doesnt show any list of events

my setup:

running file beat on Mac OS with version
filebeat-7.2.0-darwin-x86_64

./filebeat -e

seems like filebeat could connect to elasticache endpoint but never shows me anything

2

from the filebeat console

{"running":0}},"pipeline":{"clients":2,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.3867,"15":3.0552,"5":2.7393,"norm":{"1":0.2983,"15":0.3819,"5":0.3424}}}}}}
2019-07-30T09:17:15.604-0500	DEBUG	[input]	input/input.go:152	Run input
2019-07-30T09:17:15.604-0500	DEBUG	[redis]	redis/input.go:84	Run redis input with hosts: [elasticache.xyzzz.ng.0001.usw2.cache.amazonaws.com:6379]
2019-07-30T09:17:25.747-0500	DEBUG	[input]	input/input.go:152	Run input
2019-07-30T09:17:25.747-0500	DEBUG	[redis]	redis/input.go:84	Run redis input with hosts: [[elasticache.xyzzz.h.ng.0001.usw2.cache.amazonaws.com:6379]
2019-07-30T09:17:35.936-0500	DEBUG	[input]	input/input.go:152	Run input
2019-07-30T09:17:35.936-0500	DEBUG	[redis]	redis/input.go:84	Run redis input with hosts: [[elasticache.xyzzz..ng.0001.usw2.cache.amazonaws.com:6379]
2019-07-30T09:17:37.487-0500	INFO	[monitoring]	log/log.go:145	Non-zero metrics in the last 30s	{"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":140,"time":{"ms":6}},"total":{"ticks":306,"time":{"ms":16},"value":306},"user":{"ticks":166,"time":{"ms":10}}},"info":{"ephemeral_id":"ce6dd5ca-8467-4b2f-b102-ceae1282569c","uptime":{"ms":633109}},"memstats":{"gc_next":4194304,"memory_alloc":3279552,"memory_total":30217736,"rss":12288},"runtime":{"goroutines":18}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":2,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.5337,"15":3.0405,"5":2.7324,"norm":{"1":0.3167,"15":0.3801,"5":0.3416}}}}}}
3

any updates here?

4

Ok, looks like my configuration is good except for there are no slow logs in redis, so we have empty set result coming back

this is resolved now

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.