# Filebeat.exe using over 1GB of Memory on Windows

**URL:** https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775
**Category:** Beats
**Tags:** filebeat
**Created:** [November 8, 2017, 12:24am UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775 "2017-11-08T00:24:14Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![BrianBeaulieu](https://avatars.discourse-cdn.com/v4/letter/b/8797f3/32.png) [@BrianBeaulieu](https://discuss.elastic.co/u/BrianBeaulieu)
#### Post date: [November 8, 2017, 12:24am UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/1 "2017-11-08T00:24:14Z")

</div>

![2017-11-07 18_32_46-Remote Desktop Manager [RMCO - WebProd]](https://us1.discourse-cdn.com/elastic/original/3X/f/9/f956e8d2faf542034f061847c647fc99d36d135e.png)

Version 5.6.3  
Happened with older 5.x versions as well.

Can't attach memory profile text file. Summary at the bottom.

Configuration is pretty simple. 3 log files that do not rotate often.  
After running for 5 minutes ti goes from 21GB to 1.7GB in some cases.

# Config File

filebeat.prospectors:

- input\_type: log  
paths:
  - C:\ProgramData\Blah Technologies, Inc\Data Services\*\logs\log-file-json  
json.message\_key: log  
force\_close\_files: true  
fields:  
log\_type: dataservices

fields:  
client: ${CLIENT\_CODE:set-client-code}

output.logstash:  
hosts: ["[monitor.blah.com:5044](http://monitor.blah.com:5044)"]  
index: "dataservices"

* * *

# runtime.MemStats

# Alloc = 264602440

# TotalAlloc = 9738383304

# Sys = 2225985784

# Lookups = 3127

# Mallocs = 529040

# Frees = 521167

# HeapAlloc = 264602440

# HeapSys = 2152857600

# HeapIdle = 1887404032

# HeapInuse = 265453568

# HeapReleased = 0

# HeapObjects = 7873

# Stack = 262144 / 262144

# MSpan = 31200 / 901120

# MCache = 2336 / 16384

# BuckHashSys = 1497959

# NextGC = 507408872

# PauseNs = [1001700 998200 1003100 1004200 0 0 1000300 1000300 2000800 0 2000200 1001200 1002400 2001200 0 998600 1001400 0 1027200 999600 1001000 1001600 1001000 1000800 1000900 0 957300 1000400 0 2001200 0 1020100 1000500 0 1001200 1000100 1000200 998600 1000900 1000000 999500 2017800 1002700 1000000 999800 1000500 2000700 1000200 0 0 1001800 0 223000300 0 1001400 1001700 0 1002500 999400 818960200 0 999200 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]

# NumGC = 62

# DebugGC = false

---

<div class="post-metadata">

### Author: ![BrianBeaulieu](https://avatars.discourse-cdn.com/v4/letter/b/8797f3/32.png) [@BrianBeaulieu](https://discuss.elastic.co/u/BrianBeaulieu)
#### Post date: [November 8, 2017, 2:15am UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/2 "2017-11-08T02:15:38Z")

</div>

Running 32bit version, it crashes eventually.  
5.6.4 and 6.0.0rc2

runtime: VirtualAlloc of 207028224 bytes failed with errno=487  
fatal error: runtime: cannot map pages in arena address space

---

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [November 8, 2017, 11:23am UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/3 "2017-11-08T11:23:32Z")

</div>

Please properly format your configuration files, logs, and other text output using the `</>` button.

How complex are your JSON objects? Like, how 'long' are lines with JSON objects and how many keys do they have? Filebeat buffers quite a many events. You might consider to reduce the `filebeat.spool_size` to reduce the number of events in memory and/or move the actual JSON parsing to Logstash.

---

<div class="post-metadata">

### Author: ![BrianBeaulieu](https://avatars.discourse-cdn.com/v4/letter/b/8797f3/32.png) [@BrianBeaulieu](https://discuss.elastic.co/u/BrianBeaulieu)
#### Post date: [November 8, 2017, 12:24pm UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/4 "2017-11-08T12:24:13Z")

</div>

I'll answer when I get to work but just to update you I ran 6.0.0-rc2 overnight without high memory..

The JSON isn't really complex.. 2 levels deep.  
Not super long

When i tested 6.0 originally I think I goofed it up and was running the older version.

---

<div class="post-metadata">

### Author: ![BrianBeaulieu](https://avatars.discourse-cdn.com/v4/letter/b/8797f3/32.png) [@BrianBeaulieu](https://discuss.elastic.co/u/BrianBeaulieu)
#### Post date: [November 8, 2017, 12:24pm UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/5 "2017-11-08T12:24:30Z")

</div>

I'm also running it in the foreground and not as a service currently

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 6, 2017, 12:24pm UTC](https://discuss.elastic.co/t/filebeat-exe-using-over-1gb-of-memory-on-windows/106775/6 "2017-12-06T12:24:46Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
