File beat does not post the data to elk stack

[atul.bhingarde]

I have setup the file beat on one of the server and am trying to post the data from apache access log to the elk stack.

I am unable to see the logs in logstash

Thanks

Atul

[kvch (Noémi Ványi)]

Could you please share your Filebeat configuration formatted using </>? Please also share the debug logs of Filebeat (output of ./filebeat -e -d "*").

[atul.bhingarde]

you mean filebeat.yml right ?

---

filebeat.inputs:

• type: log
  enabled: false
  paths:
  • /var/log/.log
    filebeat.config.modules:
    path: ${path.config}/modules.d/.yml
    reload.enabled: false
    setup.template.settings:
    index.number_of_shards: 1
    setup.kibana:
    host: ".corporate.ge.com:5601"
    output.elasticsearch:
    hosts: [".corporate.ge.com:9200"]
    processors:
  • add_host_metadata: ~
  • add_cloud_metadata: ~
    logging.level: debug
    logging.selectors: ["*"]

---

the ---------------- is demarker and server name is kind of masked I am able to see the elk server from log source server, not sure if I nee to check the port and what log i should see on elk server ?

Thanks

Atul

[atul.bhingarde]

":6508432,"rss":17301504}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"output":{"type":"elasticsearch"},"pipeline":{"clients":0,"events":{"active":0}}},"registrar":{"states":{"current":0},"writes":{"success":1,"total":1}},"system":{"cpu":{"cores":4},"load":{"1":0.16,"15":0.01,"5":0.07,"norm":{"1":0.04,"15":0.0025,"5":0.0175}}}}}}
2019-06-05T16:32:23.982-0400 INFO [monitoring] log/log.go:153 Uptime: 3.084735751s
2019-06-05T16:32:23.982-0400 INFO [monitoring] log/log.go:130 Stopping metrics logging.
2019-06-05T16:32:23.982-0400 INFO instance/beat.go:401 filebeat stopped.
2019-06-05T16:32:23.982-0400 ERROR instance/beat.go:802 Exiting: Error getting config for fileset logstash/log: Error interpreting the template of the input: template: text:3:22: executing "text" at <.paths>: range can't iterate over /var/log/httpd/apache-play-ssl-access.log
Exiting: Error getting config for fileset logstash/log: Error interpreting the template of the input: template: text:3:22: executing "text" at <.paths>: range can't iterate over /var/log/httpd/apache-play-ssl-access.log