I seem to only be getting the node and node_stats metricsets when I enable the elasticsearch-xpack.yml module. Any ideas why? I have tried with and without the xpack.enabled: true setting.
Hi @chapterthree, welcome to the Elastic Community forums!
First off, it would be good to know your goal in using the elasticsearch module. Are you using it because you want to use the Stack Monitoring UI in Kibana? Or are you using it to simply index some monitoring data about Elasticsearch and analyze/visualize it on your own?
If it's for the Stack Monitoring UI, then you definitely want to enable the elasticsearch-xpack module, not the elasticsearch module.
As for why you are only getting node and node_stats metricsets, it would be useful to see your Metricbeat logs from the time you start up Metricbeat to about 20 seconds after that. Would you mind posting them here (delimited by ``` so they're easy to read)?
Thanks,
Shaunak
@shaunak thank you for the welcome!
I am already doing Stack Monitoring with the non-Metricbeat method (for now) and that is working fine. My primary objective in using the elasticsearch-xpack module was to get the index metricset. I want to see how fast my indices are growing over time (using Grafana).
2020-11-24T15:38:57.334-0800 INFO instance/beat.go:629 Beat ID: 4ae785f3-7e93-4a09-8100-66170867db7e
2020-11-24T15:38:57.335-0800 INFO [seccomp] seccomp/seccomp.go:124 Syscall filter successfully installed
2020-11-24T15:38:57.335-0800 INFO [beat] instance/beat.go:957 Beat info {"system_info": {"beat": {"path": {"config": "/etc/metricbeat", "data": "/var/lib/metricbeat", "home": "/usr/share/metricbeat", "logs": "/var/log/metricbeat"}, "type": "metricbeat", "uuid": "4ae785f3-7e93-4a09-8100-66170867db7e"}}}
2020-11-24T15:38:57.335-0800 INFO [beat] instance/beat.go:966 Build info {"system_info": {"build": {"commit": "5e69e25b920e3d93bec76a09a31da3ab35a55607", "libbeat": "7.7.0", "time": "2020-05-12T00:57:24.000Z", "version": "7.7.0"}}}
2020-11-24T15:38:57.335-0800 INFO [beat] instance/beat.go:969 Go runtime info {"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":4,"version":"go1.13.9"}}}
2020-11-24T15:38:57.338-0800 INFO [beat] instance/beat.go:973 Host info {"system_info": {"host": {"architecture":"x86_64","boot_time":"2020-11-13T11:42:11-08:00","containerized":false,"name":"es-data-01.ops.xxxxx","ip":["127.0.0.1/8","10.8.73.11/24"],"kernel_version":"3.10.0-1127.8.2.el7.x86_64","mac":["02:00:0a:08:49:0b"],"os":{"family":"redhat","platform":"centos","name":"CentOS Linux","version":"7 (Core)","major":7,"minor":8,"patch":2003,"codename":"Core"},"timezone":"PST","timezone_offset_sec":-28800,"id":"2fc7130956144a1aa170364ad171ed6b"}}}
2020-11-24T15:38:57.338-0800 INFO [beat] instance/beat.go:1002 Process info {"system_info": {"process": {"capabilities": {"inheritable":null,"permitted":["chown","dac_override","dac_read_search","fowner","fsetid","kill","setgid","setuid","setpcap","linux_immutable","net_bind_service","net_broadcast","net_admin","net_raw","ipc_lock","ipc_owner","sys_module","sys_rawio","sys_chroot","sys_ptrace","sys_pacct","sys_admin","sys_boot","sys_nice","sys_resource","sys_time","sys_tty_config","mknod","lease","audit_write","audit_control","setfcap","mac_override","mac_admin","syslog","wake_alarm","block_suspend"],"effective":["chown","dac_override","dac_read_search","fowner","fsetid","kill","setgid","setuid","setpcap","linux_immutable","net_bind_service","net_broadcast","net_admin","net_raw","ipc_lock","ipc_owner","sys_module","sys_rawio","sys_chroot","sys_ptrace","sys_pacct","sys_admin","sys_boot","sys_nice","sys_resource","sys_time","sys_tty_config","mknod","lease","audit_write","audit_control","setfcap","mac_override","mac_admin","syslog","wake_alarm","block_suspend"],"bounding":["chown","dac_override","dac_read_search","fowner","fsetid","kill","setgid","setuid","setpcap","linux_immutable","net_bind_service","net_broadcast","net_admin","net_raw","ipc_lock","ipc_owner","sys_module","sys_rawio","sys_chroot","sys_ptrace","sys_pacct","sys_admin","sys_boot","sys_nice","sys_resource","sys_time","sys_tty_config","mknod","lease","audit_write","audit_control","setfcap","mac_override","mac_admin","syslog","wake_alarm","block_suspend"],"ambient":null}, "cwd": "/", "exe": "/usr/share/metricbeat/bin/metricbeat", "name": "metricbeat", "pid": 32073, "ppid": 1, "seccomp": {"mode":"filter","no_new_privs":true}, "start_time": "2020-11-24T15:38:56.620-0800"}}}
2020-11-24T15:38:57.339-0800 INFO instance/beat.go:297 Setup Beat: metricbeat; Version: 7.7.0
2020-11-24T15:38:57.340-0800 INFO [publisher] pipeline/module.go:110 Beat name: es-data-01.ops.xxxxx
2020-11-24T15:38:57.407-0800 INFO instance/beat.go:438 metricbeat start running.
2020-11-24T15:38:57.418-0800 INFO filesystem/filesystem.go:57 Ignoring filesystem types: sysfs, rootfs, ramfs, bdev, proc, cgroup, cpuset, tmpfs, devtmpfs, debugfs, securityfs, sockfs, dax, bpf, pipefs, configfs, devpts, hugetlbfs, autofs, pstore, mqueue, selinuxfs, rpc_pipefs, binfmt_misc
2020-11-24T15:38:57.418-0800 INFO cfgfile/reload.go:175 Config reloader started
2020-11-24T15:38:57.422-0800 INFO filesystem/filesystem.go:57 Ignoring filesystem types: sysfs, rootfs, ramfs, bdev, proc, cgroup, cpuset, tmpfs, devtmpfs, debugfs, securityfs, sockfs, dax, bpf, pipefs, configfs, devpts, hugetlbfs, autofs, pstore, mqueue, selinuxfs, rpc_pipefs, binfmt_misc
2020-11-24T15:38:57.430-0800 INFO cfgfile/reload.go:235 Loading of config files completed.
2020-11-24T15:38:58.424-0800 INFO [publisher_pipeline_output] pipeline/output.go:101 Connecting to backoff(async(tcp://metrics.ops.xxxxx:10102))
2020-11-24T15:38:58.429-0800 INFO [publisher_pipeline_output] pipeline/output.go:111 Connection to backoff(async(tcp://metrics.ops.xxxxx:10102)) establishedThis topic was automatically closed 28 days after the last reply. New replies are no longer allowed.