I'm using functionbeat 7.1, and after great pain and countless night i was able to deploy 'function'. The inbuilt tutorial is very insufficient for development setups, as it lacks 'in-between' setups/details and configuration.
For e.g i had to add env variable ENABLED_FUNCTONS to name of function name given in functions.yml to make it work.
My uncommented *.yml looks like
functionbeat.provider.aws.functions:
- name: fun-aws
enabled: true
type: cloudwatch_logs
description: "lambda function for cloudwatch logs"
concurrency: 5
fields:
env: staging
triggers:
- log_group_name: nix-msg
- log_group_name: yum
- log_group_name: ssh
filter_pattern: i-01_
## - name: kinesis
setup.template.settings:
index.number_of_shards: 1
setup.kibana:
host: "illumin8.inboxbiz.com:5601"
protocol: "https"
username: "kibana"
password: "elk#123"
output.elasticsearch:
hosts: [ "10.27.0.4:9200" ]
protocol: "http"
username: "elastic"
password: "****"
setup.template.fields: "/root/functionbeat-7.1.1-linux-x86_64/fields.yml"
processors:
- add_host_metadata: ~
- add_cloud_metadata: ~
logging.level: debug
I run ./functionbeat deploy
I get successful message
i run setup i get
2019-08-20T09:14:57.357Z ERROR instance/beat.go:802 Exiting: Failed to import dashboard: The directory /root/functionbeat-7.1.1-linux-x86_64/kibana/7/dashboard is empty, nothing to import
Exiting: Failed to import dashboard: The directory /root/functionbeat-7.1.1-linux-x86_64/kibana/7/dashboard is empty, nothing to import
although indices are made i can verify with curl command.
Now the part of ghost indices is when i run ./logstash
I'm getting data on cli as
[monitoring] log/log.go:144 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":20,"time":{"ms":20}},"total":{"ticks":40,"time":{"ms":46},"value":40},"user":{"ticks":20,"time":{"ms":26}}},"handles":{"limit":{"hard":1048576,"soft":1024},"open":7},"info":{"ephemeral_id":"b3548f52-9c8b-4676-9c2a-d384c3d313cb","uptime":{"ms":33020}},"memstats":{"gc_next":4194304,"memory_alloc":2984240,"memory_total":4599752,"rss":29081600}},"libbeat":{"config":{"module":{"running":0}},"output":{"type":"elasticsearch"},"pipeline":{"clients":1,"events":{"active":0}}},"system":{"cpu":{"cores":4},"load":{"1":0,"15":0,"5":0,"norm":{"1":0,"15":0,"5":0}}}}}}
On indices I can see