Synthetics monitors are not working on Elastic Agent (Complete)

chrispangg · March 30, 2023, 9:14pm

The Elastic Agent is running within a container, just like the rest of the stack, in my local environment. Tried this across different versions (on 8.7 now) and they all come back with the same error.

Elastic Agent - Docker-Compose.yml

version: '3.8'
services:
  elastic-agent:
    image: docker.elastic.co/beats/elastic-agent-complete:${STACK_VERSION}
    platform: linux/amd64
    container_name: elastic-agent
    restart: always
    environment:
      - FLEET_ENROLL=1
      - FLEET_INSECURE=true
      - FLEET_URL=https://<ip-address>:8220
      - FLEET_ENROLLMENT_TOKEN=<token>==
      - cap-add=NET_RAW
      - cap-add=SETUID
      - cap-add=NET_ADMIN
    mem_limit: 750 MiB

The log looks something like this:

{"type":"synthetics/metadata","@timestamp":1680158273676346.2,"root_fields":{"num_journeys":1,"os":{"platform":"linux"},"package":{"name":"@elastic/synthetics","version":"1.0.0-beta.40"}},"payload":{"network_conditions":{"downloadThroughput":655360,"uploadThroughput":393216,"latency":20,"offline":false}},"package_version":"1.0.0-beta.40"}
browserType.launch: Browser closed.
==================== Browser output: ====================
<launching> /usr/share/elastic-agent/.cache/ms-playwright/chromium-1028/chrome-linux/chrome --disable-field-trial-config --disable-background-networking --enable-features=NetworkService,NetworkServiceInProcess --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-back-forward-cache --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-background-pages --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=ImprovedCookieControls,LazyFrameLoading,GlobalMediaControls,DestroyProfileOnBrowserClose,MediaRouter,DialMediaRouteProvider,AcceptCHFrame,AutoExpandDetailsElement,CertificateTransparencyComponentUpdater,AvoidUnnecessaryBeforeUnloadCheckSync,Translate --allow-pre-commit-input --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-backgrounding --disable-sync --force-color-profile=srgb --metrics-recording-only --no-first-run --enable-automation --password-store=basic --use-mock-keychain --no-service-autorun --export-tagged-pdf --headless --hide-scrollbars --mute-audio --blink-settings=primaryHoverType=2,availableHoverTypes=2,primaryPointerType=4,availablePointerTypes=4 --no-sandbox --disable-gpu --user-data-dir=/tmp/playwright_chromiumdev_profile-QxlXje --remote-debugging-pipe --no-startup-window
<launched> pid=1619
[pid=1619][err] [0330/063754.860740:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.490284:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.506327:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.514829:FATAL:zygote_main_linux.cc(162)] Check failed: sandbox::ThreadHelpers::IsSingleThreaded().
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400760d737 logging::LogMessage::~LogMessage()
[pid=1619][err] #3 0x00400760e4ce logging::LogMessage::~LogMessage()
[pid=1619][err] #4 0x00400715e437 content::ZygoteMain()
[pid=1619][err] #5 0x004007158871 content::RunZygote()
[pid=1619][err] #6 0x004007159734 content::RunOtherNamedProcessTypeMain()
[pid=1619][err] #7 0x00400715a617 content::ContentMainRunnerImpl::Run()
[pid=1619][err] #8 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #9 0x004007157d0e content::ContentMain()
[pid=1619][err] #10 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #11 0x0040071b9c03 headless::RunChildProcessIfNeeded()
[pid=1619][err] #12 0x0040071b87d5 headless::HeadlessShellMain()
[pid=1619][err] #13 0x0040037591e3 ChromeMain
[pid=1619][err] #14 0x00401014a083 __libc_start_main
[pid=1619][err] #15 0x00400375902a _start
[pid=1619][err]
[pid=1619][err] [0330/063755.532779:FATAL:zygote_main_linux.cc(162)] Check failed: sandbox::ThreadHelpers::IsSingleThreaded().
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400760d737 logging::LogMessage::~LogMessage()
[pid=1619][err] #3 0x00400760e4ce logging::LogMessage::~LogMessage()
[pid=1619][err] #4 0x00400715e437 content::ZygoteMain()
[pid=1619][err] #5 0x004007158871 content::RunZygote()
[pid=1619][err] #6 0x004007159734 content::RunOtherNamedProcessTypeMain()
[pid=1619][err] #7 0x00400715a617 content::ContentMainRunnerImpl::Run()
[pid=1619][err] #8 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #9 0x004007157d0e content::ContentMain()
[pid=1619][err] #10 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #11 0x0040071b9c03 headless::RunChildProcessIfNeeded()
[pid=1619][err] #12 0x0040071b87d5 headless::HeadlessShellMain()
[pid=1619][err] #13 0x0040037591e3 ChromeMain
[pid=1619][err] #14 0x00401014a083 __libc_start_main
[pid=1619][err] #15 0x00400375902a _start
[pid=1619][err]
[pid=1619][err] qemu: uncaught target signal 5 (Trace/breakpoint trap) - core dumped
[pid=1619][err] qemu: uncaught target signal 5 (Trace/breakpoint trap) - core dumped
[pid=1619][err] Received signal 11 SEGV_MAPERR 30303037653538
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400769ee61 base::debug::(anonymous namespace)::StackDumpSignalHandler()
[pid=1619][err] #3 0x00400f426420 <unknown>
[pid=1619][err] #4 0x0040087b5838 FcStrSerializeAlloc
[pid=1619][err] #5 0x0040087a3fae FcDirCacheBuild
[pid=1619][err] #6 0x0040087a9b46 FcDirCacheScan
[pid=1619][err] #7 0x0040087a9bde IA__FcDirCacheRead
[pid=1619][err] #8 0x00400879fa27 FcConfigAddDirList
[pid=1619][err] #9 0x00400879f972 IA__FcConfigBuildFonts
[pid=1619][err] #10 0x0040087ad9c1 IA__FcInitLoadConfigAndFonts
[pid=1619][err] #11 0x00400879ee12 FcConfigInit
[pid=1619][err] #12 0x00400883ad24 ZN4base12NoDestructorIN3gfx12_GLOBAL__N_116GlobalFontConfigEDnEC2IJEEEDpOT
[pid=1619][err] #13 0x00400883a61d gfx::GetGlobalFontConfig()
[pid=1619][err] #14 0x004004bd788e content::BrowserMainRunnerImpl::Initialize()
[pid=1619][err] #15 0x00400715fd8a headless::HeadlessContentMainDelegate::RunProcess()
[pid=1619][err] #16 0x004007159332 content::RunBrowserProcessMain()
[pid=1619][err] #17 0x00400715a7f2 content::ContentMainRunnerImpl::RunBrowser()
[pid=1619][err] #18 0x00400715a63b content::ContentMainRunnerImpl::Run()
[pid=1619][err] #19 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #20 0x004007157d0e content::ContentMain()
[pid=1619][err] #21 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #22 0x0040071b9a28 headless::HeadlessShellMain()
[pid=1619][err] #23 0x0040037591e3 ChromeMain
[pid=1619][err] #24 0x00401014a083 __libc_start_main
[pid=1619][err] #25 0x00400375902a _start
[pid=1619][err] r8: 000000000000c8ee r9: 000000000000000e r10: 0000000000014000 r11: 73746e6f662f6572
[pid=1619][err] r12: 00001ebc002c67c8 r13: 00001ebc00231600 r14: 0000000000000010 r15: 00001ebc002c0000
[pid=1619][err] di: 00001ebc00231ca0 si: 00001ebc00231ca0 bp: 000000400f3d1340 bx: 00001ebc00231ca0
[pid=1619][err] dx: 00000000f5e7b056 ax: 2d30303037653530 cx: 00001ebcf60ac000 sp: 000000400f3d1320
[pid=1619][err] ip: 00000040087b5838 efl: 0000000000000206 cgf: 002b000000000033 erf: 0000000000000004
[pid=1619][err] trp: ffffffffffffffff msk: 0000000000000000 cr2: 0030303037653538
[pid=1619][err] [end of stack trace]
[pid=1619][err] qemu: uncaught target signal 11 (Segmentation fault) - core dumped
=========================== logs ===========================
<launching> /usr/share/elastic-agent/.cache/ms-playwright/chromium-1028/chrome-linux/chrome --disable-field-trial-config --disable-background-networking --enable-features=NetworkService,NetworkServiceInProcess --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-back-forward-cache --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-background-pages --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=ImprovedCookieControls,LazyFrameLoading,GlobalMediaControls,DestroyProfileOnBrowserClose,MediaRouter,DialMediaRouteProvider,AcceptCHFrame,AutoExpandDetailsElement,CertificateTransparencyComponentUpdater,AvoidUnnecessaryBeforeUnloadCheckSync,Translate --allow-pre-commit-input --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-backgrounding --disable-sync --force-color-profile=srgb --metrics-recording-only --no-first-run --enable-automation --password-store=basic --use-mock-keychain --no-service-autorun --export-tagged-pdf --headless --hide-scrollbars --mute-audio --blink-settings=primaryHoverType=2,availableHoverTypes=2,primaryPointerType=4,availablePointerTypes=4 --no-sandbox --disable-gpu --user-data-dir=/tmp/playwright_chromiumdev_profile-QxlXje --remote-debugging-pipe --no-startup-window
<launched> pid=1619
[pid=1619][err] [0330/063754.860740:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.490284:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.506327:ERROR:stack_trace_posix.cc(711)] Failed to parse the contents of /proc/self/maps
[pid=1619][err] [0330/063755.514829:FATAL:zygote_main_linux.cc(162)] Check failed: sandbox::ThreadHelpers::IsSingleThreaded().
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400760d737 logging::LogMessage::~LogMessage()
[pid=1619][err] #3 0x00400760e4ce logging::LogMessage::~LogMessage()
[pid=1619][err] #4 0x00400715e437 content::ZygoteMain()
[pid=1619][err] #5 0x004007158871 content::RunZygote()
[pid=1619][err] #6 0x004007159734 content::RunOtherNamedProcessTypeMain()
[pid=1619][err] #7 0x00400715a617 content::ContentMainRunnerImpl::Run()
[pid=1619][err] #8 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #9 0x004007157d0e content::ContentMain()
[pid=1619][err] #10 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #11 0x0040071b9c03 headless::RunChildProcessIfNeeded()
[pid=1619][err] #12 0x0040071b87d5 headless::HeadlessShellMain()
[pid=1619][err] #13 0x0040037591e3 ChromeMain
[pid=1619][err] #14 0x00401014a083 __libc_start_main
[pid=1619][err] #15 0x00400375902a _start
[pid=1619][err]
[pid=1619][err] [0330/063755.532779:FATAL:zygote_main_linux.cc(162)] Check failed: sandbox::ThreadHelpers::IsSingleThreaded().
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400760d737 logging::LogMessage::~LogMessage()
[pid=1619][err] #3 0x00400760e4ce logging::LogMessage::~LogMessage()
[pid=1619][err] #4 0x00400715e437 content::ZygoteMain()
[pid=1619][err] #5 0x004007158871 content::RunZygote()
[pid=1619][err] #6 0x004007159734 content::RunOtherNamedProcessTypeMain()
[pid=1619][err] #7 0x00400715a617 content::ContentMainRunnerImpl::Run()
[pid=1619][err] #8 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #9 0x004007157d0e content::ContentMain()
[pid=1619][err] #10 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #11 0x0040071b9c03 headless::RunChildProcessIfNeeded()
[pid=1619][err] #12 0x0040071b87d5 headless::HeadlessShellMain()
[pid=1619][err] #13 0x0040037591e3 ChromeMain
[pid=1619][err] #14 0x00401014a083 __libc_start_main
[pid=1619][err] #15 0x00400375902a _start
[pid=1619][err]
[pid=1619][err] qemu: uncaught target signal 5 (Trace/breakpoint trap) - core dumped
[pid=1619][err] qemu: uncaught target signal 5 (Trace/breakpoint trap) - core dumped
[pid=1619][err] Received signal 11 SEGV_MAPERR 30303037653538
[pid=1619][err] #0 0x00400769f342 base::debug::CollectStackTrace()
[pid=1619][err] #1 0x0040076104f3 base::debug::StackTrace::StackTrace()
[pid=1619][err] #2 0x00400769ee61 base::debug::(anonymous namespace)::StackDumpSignalHandler()
[pid=1619][err] #3 0x00400f426420 <unknown>
[pid=1619][err] #4 0x0040087b5838 FcStrSerializeAlloc
[pid=1619][err] #5 0x0040087a3fae FcDirCacheBuild
[pid=1619][err] #6 0x0040087a9b46 FcDirCacheScan
[pid=1619][err] #7 0x0040087a9bde IA__FcDirCacheRead
[pid=1619][err] #8 0x00400879fa27 FcConfigAddDirList
[pid=1619][err] #9 0x00400879f972 IA__FcConfigBuildFonts
[pid=1619][err] #10 0x0040087ad9c1 IA__FcInitLoadConfigAndFonts
[pid=1619][err] #11 0x00400879ee12 FcConfigInit
[pid=1619][err] #12 0x00400883ad24 ZN4base12NoDestructorIN3gfx12_GLOBAL__N_116GlobalFontConfigEDnEC2IJEEEDpOT
[pid=1619][err] #13 0x00400883a61d gfx::GetGlobalFontConfig()
[pid=1619][err] #14 0x004004bd788e content::BrowserMainRunnerImpl::Initialize()
[pid=1619][err] #15 0x00400715fd8a headless::HeadlessContentMainDelegate::RunProcess()
[pid=1619][err] #16 0x004007159332 content::RunBrowserProcessMain()
[pid=1619][err] #17 0x00400715a7f2 content::ContentMainRunnerImpl::RunBrowser()
[pid=1619][err] #18 0x00400715a63b content::ContentMainRunnerImpl::Run()
[pid=1619][err] #19 0x004007157ba9 content::RunContentProcess()
[pid=1619][err] #20 0x004007157d0e content::ContentMain()
[pid=1619][err] #21 0x0040071b9d86 headless::(anonymous namespace)::RunContentMain()
[pid=1619][err] #22 0x0040071b9a28 headless::HeadlessShellMain()
[pid=1619][err] #23 0x0040037591e3 ChromeMain
[pid=1619][err] #24 0x00401014a083 __libc_start_main
[pid=1619][err] #25 0x00400375902a _start
[pid=1619][err] r8: 000000000000c8ee r9: 000000000000000e r10: 0000000000014000 r11: 73746e6f662f6572
[pid=1619][err] r12: 00001ebc002c67c8 r13: 00001ebc00231600 r14: 0000000000000010 r15: 00001ebc002c0000
[pid=1619][err] di: 00001ebc00231ca0 si: 00001ebc00231ca0 bp: 000000400f3d1340 bx: 00001ebc00231ca0
[pid=1619][err] dx: 00000000f5e7b056 ax: 2d30303037653530 cx: 00001ebcf60ac000 sp: 000000400f3d1320
[pid=1619][err] ip: 00000040087b5838 efl: 0000000000000206 cgf: 002b000000000033 erf: 0000000000000004
[pid=1619][err] trp: ffffffffffffffff msk: 0000000000000000 cr2: 0030303037653538
[pid=1619][err] [end of stack trace]
[pid=1619][err] qemu: uncaught target signal 11 (Segmentation fault) - core dumped at Function.setupDriver (/usr/share/elastic-agent/.node/node/lib/node_modules/@elastic/synthetics/src/core/gatherer.ts:52:43)
at Function.createContext (/usr/share/elastic-agent/.node/node/lib/node_modules/@elastic/synthetics/src/core/runner.ts:77:35)
at Runner.runJourney (/usr/share/elastic-agent/.node/node/lib/node_modules/@elastic/synthetics/src/core/runner.ts:342:34)
at Runner.run (/usr/share/elastic-agent/.node/node/lib/node_modules/@elastic/synthetics/src/core/runner.ts:445:22)
at Command.<anonymous> (/usr/share/elastic-agent/.node/node/lib/node_modules/@elastic/synthetics/src/cli.ts:133:23) {
name: 'Error'
}

chrispangg · April 3, 2023, 12:31am

Update: I have solved this issue. Apparently Apple Silicon can't render browser correctly in a docker unless you enable the beta feature 'Use Rosetta for x86/amd64 emulation on Apple Silicon' in the docker settings, as suggested in this here: [Bug]: Running puppeteer on docker alpine on Mac failed · Issue #7746 · puppeteer/puppeteer · GitHub.

system · May 1, 2023, 12:31am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Trying to use Synthetics but it shows an error on enrollment Elasticsearch docker , fleet	2	838	August 21, 2023
Synthetics failing silently? Synthetics	11	1597	February 23, 2022
Elastic agent complete (7.17.1) stops working Synthetics docker , elastic-agent	5	404	July 29, 2022
Monitor synthetics in status "Pending" v8.14.0 Synthetics docker	2	37	October 3, 2024
Fleet Synthetics 7.14 - pipeline with id [synthetics-http-0.2.1] does not exist Elasticsearch docker , fleet	7	674	September 16, 2021

Synthetics monitors are not working on Elastic Agent (Complete)

Related topics