Issue about starting beats

Hi All,

I was wondering if you can advise on this issue I am getting with starting the beats or if anyone has seen this issue before.

I have created a virtual machine on virtual box with an Ubuntu OS. I have tried to setup opbeans-java demo on the Ubuntu OS which is using a docker container (unsure if this is related), and does appear in APM of Kibana. Then I have downloaded the elastic beat versions of 7.2.1 as the cluster generated from this demo uses version 7.3.0.

When I start the beats (heartbeat / metricbeat / filebeat) it generates this error below:

root@observability-VirtualBox:/etc/heartbeat/heartbeat-7.2.1-linux-x86_64# ./heartbeat -e -d "*"

2023-01-29T12:50:09.223Z	INFO	instance/beat.go:606	Home path: [/etc/heartbeat/heartbeat-7.2.1-linux-x86_64] Config path: [/etc/heartbeat/heartbeat-7.2.1-linux-x86_64] Data path: [/etc/heartbeat/heartbeat-7.2.1-linux-x86_64/data] Logs path: [/etc/heartbeat/heartbeat-7.2.1-linux-x86_64/logs]

2023-01-29T12:50:09.224Z	DEBUG	[beat]	instance/beat.go:658	Beat metadata path: /etc/heartbeat/heartbeat-7.2.1-linux-x86_64/data/meta.json

2023-01-29T12:50:09.224Z	INFO	instance/beat.go:614	Beat ID: 8730f5f2-4068-4f75-a2a4-dec9a938ec31

2023-01-29T12:50:09.227Z	DEBUG	[processors]	processors/processor.go:93	Generated new processors: add_observer_metadata=[netinfo.enabled=[false], cache.ttl=[5m0s]]

2023-01-29T12:50:09.228Z	DEBUG	[seccomp]	seccomp/seccomp.go:109	Loading syscall filter	{"seccomp_filter": {"no_new_privs":true,"flag":"tsync","policy":{"default_action":"errno","syscalls":[{"names":["accept","accept4","access","arch_prctl","bind","brk","clock_gettime","clone","close","connect","dup","dup2","epoll_create","epoll_create1","epoll_ctl","epoll_pwait","epoll_wait","exit","exit_group","fchdir","fchmod","fchown","fcntl","fdatasync","flock","fstat","fstatfs","fsync","ftruncate","futex","getcwd","getdents","getdents64","geteuid","getgid","getpeername","getpid","getppid","getrandom","getrlimit","getrusage","getsockname","getsockopt","gettid","gettimeofday","getuid","inotify_add_watch","inotify_init1","inotify_rm_watch","ioctl","kill","listen","lseek","lstat","madvise","mincore","mkdirat","mmap","mprotect","munmap","nanosleep","newfstatat","open","openat","pipe","pipe2","poll","ppoll","pread64","pselect6","pwrite64","read","readlink","readlinkat","recvfrom","recvmmsg","recvmsg","rename","renameat","rt_sigaction","rt_sigprocmask","rt_sigreturn","sched_getaffinity","sched_yield","sendfile","sendmmsg","sendmsg","sendto","set_robust_list","setitimer","setsockopt","shutdown","sigaltstack","socket","splice","stat","statfs","sysinfo","tgkill","time","tkill","uname","unlink","unlinkat","wait4","waitid","write","writev"],"action":"allow"}]}}}

2023-01-29T12:50:09.229Z	INFO	[seccomp]	seccomp/seccomp.go:116	Syscall filter successfully installed

2023-01-29T12:50:09.230Z	INFO	[beat]	instance/beat.go:902	Beat info	{"system_info": {"beat": {"path": {"config": "/etc/heartbeat/heartbeat-7.2.1-linux-x86_64", "data": "/etc/heartbeat/heartbeat-7.2.1-linux-x86_64/data", "home": "/etc/heartbeat/heartbeat-7.2.1-linux-x86_64", "logs": "/etc/heartbeat/heartbeat-7.2.1-linux-x86_64/logs"}, "type": "heartbeat", "uuid": "8730f5f2-4068-4f75-a2a4-dec9a938ec31"}}}

2023-01-29T12:50:09.231Z	INFO	[beat]	instance/beat.go:911	Build info	{"system_info": {"build": {"commit": "dd3f47f0fb299aa5de9c5c1468faacc1b9b3c27f", "libbeat": "7.2.1", "time": "2019-07-24T16:54:59.000Z", "version": "7.2.1"}}}

2023-01-29T12:50:09.231Z	INFO	[beat]	instance/beat.go:914	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":1,"version":"go1.12.4"}}}

runtime/cgo: pthread_create failed: Operation not permitted

SIGABRT: abort

PC=0x7fbf9de9226b m=3 sigcode=18446744073709551610



goroutine 0 [idle]:

runtime: unknown pc 0x7fbf9de9226b

stack: frame={sp:0x7fbf9b3ac9a0, fp:0x0} stack=[0x7fbf9abad268,0x7fbf9b3ace68)

00007fbf9b3ac8a0:  0000000000000000  0000000000000000 

00007fbf9b3ac8b0:  0000000000000000  0000000000000000 

00007fbf9b3ac8c0:  0000000000000000  0000000000000000 

00007fbf9b3ac8d0:  0000000000000000  0000000000000000 

00007fbf9b3ac8e0:  0000000000000000  0000000000000000 

00007fbf9b3ac8f0:  0000000000000000  0000000000000000 

00007fbf9b3ac900:  0000000000000000  0000000000000000 

00007fbf9b3ac910:  0000000000000011  0000000000000000 

00007fbf9b3ac920:  0000000000000000  00007fbf9df1f5e1 

00007fbf9b3ac930:  00007fbf99b6a6c0  00007fbf9b3acbb0 

00007fbf9b3ac940:  00007fbf9b3aca66  0000000000000000 

00007fbf9b3ac950:  00007fbf9b3aca67  00007fbf9de90010 

00007fbf9b3ac960:  0000000000000000  0000000000000000 

00007fbf9b3ac970:  00000000003d0f00  00007fbf99b6a990 

00007fbf9b3ac980:  00007fbf99b6a990  00007fbf99b6a990 

00007fbf9b3ac990:  0000000000000000  00007fbf9de9225e 

00007fbf9b3ac9a0: <00000000007fff80  7dc7d551b1896800 

00007fbf9b3ac9b0:  0000000000000006  00007fbf9b3ad6c0 

00007fbf9b3ac9c0:  0000000003d0f430  0000000000000011 

00007fbf9b3ac9d0:  00000000019122a0  00007fbf9de3bc46 

00007fbf9b3ac9e0:  00007fbf9dff7e70  00007fbf9de227fc 

00007fbf9b3ac9f0:  0000000000000020  00007fbf9dff7680 

00007fbf9b3aca00:  0000000000000001  00007fbf9dff7703 

00007fbf9b3aca10:  0000000000000d68  00007fbf9de88341 

00007fbf9b3aca20:  415353454d5f434c  00007fbf9dff7680 

00007fbf9b3aca30:  000000000000000a  00007fbf9b3ad6c0 

00007fbf9b3aca40:  0000000000000011  00000000019122a0 

00007fbf9b3aca50:  0000000000000000  00007fbf9de887e3 

00007fbf9b3aca60:  00007fbf9dff7680  000000000000000a 

00007fbf9b3aca70:  00007fbf9b3ad6c0  00007fbf9de830aa 

00007fbf9b3aca80:  00007fbf9dff7840  7dc7d551b1896800 

00007fbf9b3aca90:  00007fbf9dff7840  00007fbf9dff7840 

runtime: unknown pc 0x7fbf9de9226b

stack: frame={sp:0x7fbf9b3ac9a0, fp:0x0} stack=[0x7fbf9abad268,0x7fbf9b3ace68)

00007fbf9b3ac8a0:  0000000000000000  0000000000000000 

00007fbf9b3ac8b0:  0000000000000000  0000000000000000 

00007fbf9b3ac8c0:  0000000000000000  0000000000000000 

00007fbf9b3ac8d0:  0000000000000000  0000000000000000 

00007fbf9b3ac8e0:  0000000000000000  0000000000000000 

00007fbf9b3ac8f0:  0000000000000000  0000000000000000 

00007fbf9b3ac900:  0000000000000000  0000000000000000 

00007fbf9b3ac910:  0000000000000011  0000000000000000 

00007fbf9b3ac920:  0000000000000000  00007fbf9df1f5e1 

00007fbf9b3ac930:  00007fbf99b6a6c0  00007fbf9b3acbb0 

00007fbf9b3ac940:  00007fbf9b3aca66  0000000000000000 

00007fbf9b3ac950:  00007fbf9b3aca67  00007fbf9de90010 

00007fbf9b3ac960:  0000000000000000  0000000000000000 

00007fbf9b3ac970:  00000000003d0f00  00007fbf99b6a990 

00007fbf9b3ac980:  00007fbf99b6a990  00007fbf99b6a990 

00007fbf9b3ac990:  0000000000000000  00007fbf9de9225e 

00007fbf9b3ac9a0: <00000000007fff80  7dc7d551b1896800 

00007fbf9b3ac9b0:  0000000000000006  00007fbf9b3ad6c0 

00007fbf9b3ac9c0:  0000000003d0f430  0000000000000011 

00007fbf9b3ac9d0:  00000000019122a0  00007fbf9de3bc46 

00007fbf9b3ac9e0:  00007fbf9dff7e70  00007fbf9de227fc 

00007fbf9b3ac9f0:  0000000000000020  00007fbf9dff7680 

00007fbf9b3aca00:  0000000000000001  00007fbf9dff7703 

00007fbf9b3aca10:  0000000000000d68  00007fbf9de88341 

00007fbf9b3aca20:  415353454d5f434c  00007fbf9dff7680 

00007fbf9b3aca30:  000000000000000a  00007fbf9b3ad6c0 

00007fbf9b3aca40:  0000000000000011  00000000019122a0 

00007fbf9b3aca50:  0000000000000000  00007fbf9de887e3 

00007fbf9b3aca60:  00007fbf9dff7680  000000000000000a 

00007fbf9b3aca70:  00007fbf9b3ad6c0  00007fbf9de830aa 

00007fbf9b3aca80:  00007fbf9dff7840  7dc7d551b1896800 

00007fbf9b3aca90:  00007fbf9dff7840  00007fbf9dff7840 



goroutine 12 [syscall]:

runtime.notetsleepg(0x24ffe60, 0x129478ccd, 0x0)

	/usr/local/go/src/runtime/lock_futex.go:227 +0x34 fp=0xc00005f760 sp=0xc00005f730 pc=0x9e48e4

runtime.timerproc(0x24ffe40)

	/usr/local/go/src/runtime/time.go:311 +0x2ea fp=0xc00005f7d8 sp=0xc00005f760 pc=0xa2680a

runtime.goexit()

	/usr/local/go/src/runtime/asm_amd64.s:1337 +0x1 fp=0xc00005f7e0 sp=0xc00005f7d8 pc=0xa37081

created by runtime.(*timersBucket).addtimerLocked

	/usr/local/go/src/runtime/time.go:169 +0x10e



goroutine 1 [runnable]:

syscall.ParseNetlinkRouteAttr(0xc0001f0ba8, 0x0, 0x0, 0x0, 0x1, 0xc00043c700)

	/usr/local/go/src/syscall/netlink_linux.go:167 +0x1ae

net.interfaceTable(0x0, 0x0, 0x0, 0x0, 0x0, 0x0)

	/usr/local/go/src/net/interface_linux.go:34 +0x296

net.Interfaces(0x0, 0x0, 0x0, 0x0, 0x0)

	/usr/local/go/src/net/interface.go:100 +0x2e

github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/shared.Network(0x0, 0xc0001f0e01, 0xc0001f0e88, 0xbc2077, 0xc000474040, 0x18, 0x0, 0x0)

	/go/src/github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/shared/network.go:25 +0x37

github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux.(*reader).network(0xc0001f0fc8, 0xc00000c780)

	/go/src/github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux/host_linux.go:166 +0x34

github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux.newHost(0x17a5a98, 0x5, 0x17a5a98, 0x5, 0x1, 0x2, 0xc0000e49a0)

	/go/src/github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux/host_linux.go:104 +0x1e0

github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux.linuxSystem.Host(...)

	/go/src/github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/providers/linux/host_linux.go:52

github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo.Host(...)

	/go/src/github.com/elastic/beats/vendor/github.com/elastic/go-sysinfo/system.go:50

github.com/elastic/beats/libbeat/cmd/instance.logSystemInfo(0x17ab09f, 0x9, 0x17ab09f, 0x9, 0x17a5b06, 0x5, 0xc0002a2f80, 0x18, 0xc0002a2f80, 0x18, ...)

	/go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:917 +0x13db

github.com/elastic/beats/libbeat/cmd/instance.(*Beat).createBeater(0xc000372fc0, 0x17fcf58, 0x0, 0x24, 0x0, 0x0)

	/go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:291 +0xa9

github.com/elastic/beats/libbeat/cmd/instance.(*Beat).launch(0xc000372fc0, 0x17ab09f, 0x9, 0x17ab09f, 0x9, 0x0, 0x0, 0x0, 0x0, 0x0, ...)

	/go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:383 +0x35f

github.com/elastic/beats/libbeat/cmd/instance.Run.func1(0x17ab09f, 0x9, 0x17ab09f, 0x9, 0x0, 0x0, 0x17ab09f, 0x9, 0x17ab09f, 0x9, ...)

	/go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:182 +0x51d

github.com/elastic/beats/libbeat/cmd/instance.Run(0x17ab09f, 0x9, 0x17ab09f, 0x9, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)

	/go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:183 +0xbe

github.com/elastic/beats/libbeat/cmd.genRunCmd.func1(0xc000359900, 0xc0003535c0, 0x0, 0x3)

	/go/src/github.com/elastic/beats/libbeat/cmd/run.go:36 +0x9a

github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).execute(0xc000359900, 0xc00003c0d0, 0x3, 0x3, 0xc000359900, 0xc00003c0d0)

	/go/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:704 +0x289

github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc000359900, 0x14b9c6a, 0xc0001f1f88, 0xc000086058)

	/go/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:785 +0x2ca

github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).Execute(...)

	/go/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:738

main.main()

	/go/src/github.com/elastic/beats/x-pack/heartbeat/main.go:16 +0x30



goroutine 11 [syscall]:

os/signal.signal_recv(0x0)

	/usr/local/go/src/runtime/sigqueue.go:139 +0x9c

os/signal.loop()

	/usr/local/go/src/os/signal/signal_unix.go:23 +0x22

created by os/signal.init.0

	/usr/local/go/src/os/signal/signal_unix.go:29 +0x41



rax    0x0

rbx    0xe353

rcx    0x7fbf9de9226b

rdx    0x6

rdi    0xe351

rsi    0xe353

rbp    0x6

rsp    0x7fbf9b3ac9a0

r8     0x0

r9     0x73

r10    0x8

r11    0x246

r12    0x16

r13    0x11

r14    0x19122a0

r15    0x0

rip    0x7fbf9de9226b

rflags 0x246

cs     0x33

fs     0x0

Would anyone have seen this error before or know why this is happening? I just want to connect the beats to the stack

Kind Regards,
Chris

Hello @chris3 , it seems a similar issue was reported for APM back in September 2021, and is related to seccomp policy on linux hosts: runtime/cgo: pthread_create failed: Operation not permitted on glibc 2.34 · Issue #6238 · elastic/apm-server · GitHub
Also, a similar issue was raised for docker containers: runtime/cgo: pthread_create failed: Operation not permitted · Issue #1501 · containers/skopeo · GitHub

However, for both cases the issue has been resolved, so may be try using the latest version of Elastic Stack and Docker to create the images.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.