# Elastic Agent Heartbeat Folder filled with Core Dumps

**URL:** <https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262>\
**Category:** Beats\
**Tags:** docker, heartbeat\
**Created:** [March 31, 2022, 9:23pm UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262 "2022-03-31T21:23:04Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![RichiCoder](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richicoder/32/103790_2.png) [@RichiCoder](https://discuss.elastic.co/u/RichiCoder)\
**Post date:** [March 31, 2022, 9:23pm UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/1 "2022-03-31T21:23:04Z")

</div>

Howdy! We're using the Elastic Agent's synthetic agent running in docker to monitor some web properties. There's no visible issues or errors, but after some time the agent "dies" for lack of a better term. After some investigation, it looks like the container is running out of disk space because the `/usr/share/elastic-agent/data/elastic-agent-1d05ba/install/heartbeat-7.17.1-linux-x86_64` is filling up with `core.XXX` files which I can only assume are core dumps.

Is there some way we can diagnose this, or something we might be doing wrong?

---

<div class="post-metadata">

**Author:** ![Andrew\_Cholakian1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrew_cholakian1/32/3612_2.png) [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Post date:** [April 1, 2022, 12:20am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/2 "2022-04-01T00:20:14Z")

</div>

Thanks for the heads-up. This is a weird one that we've had some trouble reproducing, it's caused by chromium crashing. We do have a tracking issue here: [[7.17] [Heartbeat] Crash core dump files generated for synthetic monitors · Issue #30426 · elastic/beats · GitHub](https://github.com/elastic/beats/issues/30426)

@vigneshshanmugam might have some thoughts on next steps, or possibly some debugging questions that may help out here.

I'm wondering if just updating to a newer playwright version for synthetics may help.

---

<div class="post-metadata">

**Author:** ![RichiCoder](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richicoder/32/103790_2.png) [@RichiCoder](https://discuss.elastic.co/u/RichiCoder)\
**Post date:** [April 1, 2022, 12:33am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/3 "2022-04-01T00:33:47Z")

</div>

Reading over that issue, that's exactly what we're running into. Came to the same conclusion that it was a weird SIGABRT in Chrome, and ended up disabling core dumps in the container to resolve it temporarily.

---

<div class="post-metadata">

**Author:** ![Andrew\_Cholakian1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrew_cholakian1/32/3612_2.png) [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Post date:** [April 1, 2022, 1:09am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/4 "2022-04-01T01:09:01Z")

</div>

Which method did you use to disable core dumps in the container? Last I checked our container was set to disable them, but I'm wondering if you're using a different setting, or if you had overriden that.

---

<div class="post-metadata">

**Author:** ![RichiCoder](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richicoder/32/103790_2.png) [@RichiCoder](https://discuss.elastic.co/u/RichiCoder)\
**Post date:** [April 1, 2022, 1:26am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/5 "2022-04-01T01:26:34Z")

</div>

Set `core` in ulimits to `0` I believe? Not sure if that could be done genericly, but I'm also not that familiar period with the underlying bits.

---

<div class="post-metadata">

**Author:** ![Andrew\_Cholakian1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrew_cholakian1/32/3612_2.png) [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Post date:** [April 1, 2022, 2:12am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/6 "2022-04-01T02:12:32Z")

</div>

That's very helpful, thanks for sharing @RichiCoder , was it set to something other than 0 prior? On my system it's set to `0` by default. As a heads-up we're looking into upgrading playwright (which brings in a newer version of chrome) in [Upgrade playwright to 1.17.0 by andrewvc · Pull Request #483 · elastic/synthetics · GitHub](https://github.com/elastic/synthetics/pull/483)

Additionally, I'm considering opening an issue around doing a better job enforcing the ulimit for core dumps, but it'd be great if we can repro this first.

---

<div class="post-metadata">

**Author:** ![Andrew\_Cholakian1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrew_cholakian1/32/3612_2.png) [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Post date:** [April 1, 2022, 2:14am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/7 "2022-04-01T02:14:44Z")

</div>

Could you perhaps share your system info and how docker was setup? I'm trying to figure out if the default core limit of `0` was overriden anywhere.

Obviously, our first choice would be for chromium not to crash, but that is always a risk, and when it does it'd be best not to leave a core.

---

<div class="post-metadata">

**Author:** ![RichiCoder](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richicoder/32/103790_2.png) [@RichiCoder](https://discuss.elastic.co/u/RichiCoder)\
**Post date:** [April 1, 2022, 2:50am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/8 "2022-04-01T02:50:57Z")

</div>

I'll be honest, I'm not sure what the default might be.

For context, we're running a relatively vanilla AWS Elastic Container Service cluster, with the container compute being provided by Fargate. So, I'm not super familiar with what the defaults are aside from the odd issue. You could probably reproduce with a bare bone cluster and the lowest tier task compute, and just run a synthetic at a fast interval.

Glad to see it's being upgraded! I'm a big playwright fan and reached for some recent APIs when writing the tests in questions and ran into sharp edges as a result (especially since I ran into another now solved(?) issue where errors weren't bubbling up in an easily visible way).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 29, 2022, 4:51am UTC](https://discuss.elastic.co/t/elastic-agent-heartbeat-folder-filled-with-core-dumps/301262/9 "2022-04-29T04:51:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
