Filebeat not publishing logs to Logstash on sebp/elk docker image

I run filebeat with this command 'sudo ./filebeat -e -c filebeat.yml'.

2021-02-05T14:10:29.915+0530 INFO instance/beat.go:640 Home path: [/Users/pavitardua/filebeat-7.9.2-darwin-x86_64] Config path: [/Users/pavitardua/filebeat-7.9.2-darwin-x86_64] Data path: [/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/data] Logs path: [/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/logs]

2021-02-05T14:10:29.916+0530 INFO instance/beat.go:648 Beat ID: e08e93ed-8414-48b7-826d-eef66eb24eeb

2021-02-05T14:10:29.952+0530 INFO [beat] instance/beat.go:976 Beat info {"system_info": {"beat": {"path": {"config": "/Users/pavitardua/filebeat-7.9.2-darwin-x86_64", "data": "/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/data", "home": "/Users/pavitardua/filebeat-7.9.2-darwin-x86_64", "logs": "/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/logs"}, "type": "filebeat", "uuid": "e08e93ed-8414-48b7-826d-eef66eb24eeb"}}}

2021-02-05T14:10:29.952+0530 INFO [beat] instance/beat.go:985 Build info {"system_info": {"build": {"commit": "2ab907f5ccecf9fd82fe37105082e89fd871f684", "libbeat": "7.9.2", "time": "2020-09-22T23:19:44.000Z", "version": "7.9.2"}}}

2021-02-05T14:10:29.952+0530 INFO [beat] instance/beat.go:988 Go runtime info {"system_info": {"go": {"os":"darwin","arch":"amd64","max_procs":4,"version":"go1.14.7"}}}

2021-02-05T14:10:29.957+0530 INFO [beat] instance/beat.go:992 Host info {"system_info": {"host": {"architecture":"x86_64","boot_time":"2021-01-28T01:27:13.219716+05:30","name":"mobiuso-3.local","ip":["127.0.0.1/8","::1/128","fe80::1/64","fe80::1008:601d:4cab:7f8e/64","192.168.43.242/24","2405:204:282:33b3:83f:314b:7720:fbc6/64","2405:204:282:33b3:2da0:d346:e826:1a81/64","fe80::2c1a:2bff:fec5:8d0/64","fe80::2c1a:2bff:fec5:8d0/64","fe80::8c0:ee28:fe53:3c49/64","fe80::d296:c38c:477d:ae03/64"],"kernel_version":"19.4.0","mac":["8c:85:90:98:5a:5f","82:bf:95:06:2c:01","82:bf:95:06:2c:00","82:bf:95:06:2c:01","0e:85:90:98:5a:5f","2e:1a:2b:c5:08:d0","2e:1a:2b:c5:08:d0"],"os":{"family":"darwin","platform":"darwin","name":"Mac OS X","version":"10.15.4","major":10,"minor":15,"patch":4,"build":"19E287"},"timezone":"IST","timezone_offset_sec":19800,"id":"BE579B15-3DAE-5FF3-81F5-4DED139A21D4"}}}

2021-02-05T14:10:29.958+0530 INFO [beat] instance/beat.go:1021 Process info {"system_info": {"process": {"cwd": "/Users/pavitardua/filebeat-7.9.2-darwin-x86_64", "exe": "./filebeat", "name": "filebeat", "pid": 40474, "ppid": 40473, "start_time": "2021-02-05T14:10:29.852+0530"}}}

2021-02-05T14:10:29.958+0530 INFO instance/beat.go:299 Setup Beat: filebeat; Version: 7.9.2

2021-02-05T14:10:29.959+0530 INFO [publisher] pipeline/module.go:113 Beat name: mobiuso-3.local

2021-02-05T14:10:29.960+0530 WARN beater/filebeat.go:178 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.

2021-02-05T14:10:29.960+0530 INFO [monitoring] log/log.go:118 Starting metrics logging every 30s

2021-02-05T14:10:29.960+0530 INFO instance/beat.go:450 filebeat start running.

2021-02-05T14:10:29.960+0530 INFO memlog/store.go:119 Loading data file of '/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/data/registry/filebeat' succeeded. Active transaction id=0

2021-02-05T14:10:29.961+0530 INFO memlog/store.go:124 Finished loading transaction log file for '/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/data/registry/filebeat'. Active transaction id=0

2021-02-05T14:10:29.961+0530 WARN beater/filebeat.go:381 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.

2021-02-05T14:10:29.961+0530 INFO [registrar] registrar/registrar.go:109 States Loaded from registrar: 0

2021-02-05T14:10:29.961+0530 INFO [crawler] beater/crawler.go:71 Loading Inputs: 1

2021-02-05T14:10:29.961+0530 INFO log/input.go:157 Configured paths: [/Users/pavitardua/filebeat-7.9.2-darwin-x86_64/~/projects/alphayouthsports/logs/trainingService/audit.log]

2021-02-05T14:10:29.961+0530 INFO [crawler] beater/crawler.go:141 Starting input (ID: 218382624911205674)

2021-02-05T14:10:29.962+0530 INFO [crawler] beater/crawler.go:108 Loading and starting Inputs completed. Enabled inputs: 1

2021-02-05T14:10:29.962+0530 INFO cfgfile/reload.go:164 Config reloader started

2021-02-05T14:10:29.962+0530 INFO cfgfile/reload.go:224 Loading of config files completed.

2021-02-05T14:10:32.922+0530 INFO [add_cloud_metadata] add_cloud_metadata/add_cloud_metadata.go:89 add_cloud_metadata: hosting provider type not detected.

After this it keeps printing monitoring

2021-02-05T14:10:59.963+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":72,"time":{"ms":72}},"total":{"ticks":172,"time":{"ms":172},"value":172},"user":{"ticks":100,"time":{"ms":100}}},"info":{"ephemeral_id":"67db297c-d470-4f92-84da-9472caf1ed44","uptime":{"ms":30092}},"memstats":{"gc_next":15908112,"memory_alloc":8367136,"memory_total":36163384,"rss":46252032},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0},"reloads":1,"scans":1},"output":{"type":"logstash"},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"cpu":{"cores":4},"load":{"1":3.4497,"15":5.1099,"5":4.4995,"norm":{"1":0.8624,"15":1.2775,"5":1.1249}}}}}}
2021-02-05T14:11:29.964+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":77,"time":{"ms":6}},"total":{"ticks":180,"time":{"ms":9},"value":180},"user":{"ticks":103,"time":{"ms":3}}},"info":{"ephemeral_id":"67db297c-d470-4f92-84da-9472caf1ed44","uptime":{"ms":60090}},"memstats":{"gc_next":15908112,"memory_alloc":9732992,"memory_total":37529240,"rss":-14606336},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":3.4961,"15":5.0415,"5":4.3784,"norm":{"1":0.874,"15":1.2604,"5":1.0946}}}}}}
2021-02-05T14:11:59.974+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":82,"time":{"ms":4}},"total":{"ticks":188,"time":{"ms":7},"value":188},"user":{"ticks":106,"time":{"ms":3}}},"info":{"ephemeral_id":"67db297c-d470-4f92-84da-9472caf1ed44","uptime":{"ms":90090}},"memstats":{"gc_next":15908112,"memory_alloc":10834496,"memory_total":38630744,"rss":876544},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.7773,"15":4.9233,"5":4.1182,"norm":{"1":0.6943,"15":1.2308,"5":1.0295}}}}}}
2021-02-05T14:12:29.974+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":100,"time":{"ms":18}},"total":{"ticks":216,"time":{"ms":29},"value":216},"user":{"ticks":116,"time":{"ms":11}}},"info":{"ephemeral_id":"67db297c-d470-4f92-84da-9472caf1ed44","uptime":{"ms":120101}},"memstats":{"gc_next":15734512,"memory_alloc":10534104,"memory_total":39728592,"rss":-1282048},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.1343,"15":4.7915,"5":3.834,"norm":{"1":0.5336,"15":1.1979,"5":0.9585}}}}}}

Filebeat does not event attempt to connect to backoff.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.