# Exception caught on netty layer - java.lang.OutOfMemoryError **URL:** \ **Category:** Elasticsearch\ **Created:** [August 22, 2018, 4:18pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588 "2018-08-22T16:18:42Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 22, 2018, 4:18pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/1 "2018-08-22T16:18:43Z")
Hi folks, I keep on getting a JVM out of memory error. I have used the option to disable index closing, so when this error does occur the indexes do not close. I would appreciate any advice on this. Thanks in advance. Sanj I have attached the logs and machine configuration. I am using a virtual machine. jvm.options file: -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.io.tmpdir=${ES\_TMPDIR} -XX:+HeapDumpOnOutOfMemoryError -Xmx8192m -Xms8192m exception caught on netty layer java.lang.OutOfMemoryError es 6.3.4 jvm 1.8\_181 Physical Ram: 16GB JVM: 8 GB Windows server 2016 2018-08-21T16:47:02,511][INFO][o.e.c.s.ClusterSettings] [CBDES02] updating [cluster.indices.close.enable] from [true] to [false] [2018-08-21T17:31:02,542][WARN][monitor.jvm] [NODE1] [gc][ParNew][3246454][64605] duration [822ms], collections [1]/[4.3s], total [822ms]/[21m], memory [966.1mb]-\>[766.9mb]/[990.7mb], all\_pools {[Code Cache] [13.1mb]-\>[13.1mb]/[48mb]}{[Par Eden Space] [266.2mb]-\>[75.6mb]/[266.2mb]}{[Par Survivor Space] [8.9mb]-\>[0b]/[33.2mb]}{[CMS Old Gen] [690.8mb]-\>[691.2mb]/[691.2mb]}{[CMS Perm Gen] [33.6mb]-\>[33.6mb]/[82mb]} [2018-08-21T17:31:02,542][WARN][transport.netty] [NODE1] exception caught on netty layer[[id: 0x03d14f1c, / 10.0.6.100:36055 =\> / 10.0.6.105:9300]]java.lang.OutOfMemoryError: Java heap space at org.apache.lucene.util.PriorityQueue.initialize(PriorityQueue.java:108) at org.elasticsearch.search.controller.ScoreDocQueue.(ScoreDocQueue.java:32)[2018-08-21T17:31:02,975][WARN][r.suppressed] path: /\_all/\_close, params: {index=\_all} java.lang.IllegalStateException: closing indices is disabled - set [cluster.indices.close.enable: true] to enable it. NOTE: closed indices still consume a significant amount of diskspace at org.elasticsearch.action.admin.indices.close.TransportCloseIndexAction.doExecute(TransportCloseIndexAction.java:87) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.action.admin.indices.close.TransportCloseIndexAction.doExecute(TransportCloseIndexAction.java:48) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:83) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:72) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:405) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1253) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.close(AbstractClient.java:1409) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.rest.action.admin.indices.RestCloseIndexAction.lambda$prepareRequest$0(RestCloseIndexAction.java:52) ~[elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:97) [elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:240) [elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:336) [elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:174) [elasticsearch-6.2.4.jar:6.2.4] at org.elasticsearch.http.netty4.Netty4HttpServerTransport.dispatchRequest(Netty4HttpServerTransport.java:500) [transport-netty4-6.2.4.jar:6.2.4] at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:80) [transport-netty4-6.2.4.jar:6.2.4] at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at org.elasticsearch.http.netty4.pipelining.HttpPipeliningHandler.channelRead(HttpPipeliningHandler.java:68) [transport-netty4-6.2.4.jar:6.2.4] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [netty-codec-4.1.16.Final.jar:4.1.16.Final] at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final] at ---
**Author:** ![Magnus\_Kessler](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnus_kessler/32/42001_2.png) [@Magnus\_Kessler](https://discuss.elastic.co/u/Magnus_Kessler)\ **Post date:** [August 22, 2018, 4:56pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/2 "2018-08-22T16:56:37Z")
Can you provide some details of the operations you run on the cluster? What does your data model look like? Are you performing specific queries when the node runs out of memory? A common cause for OOM is a nested aggregation query on high cardinality fields. The underlying issue for your node running out of memory is not going to be solved by setting `cluster.indices.close.enable` to `false`. See the [documentation](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-open-close.html) for what closing an index means. ---
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 22, 2018, 6:53pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/3 "2018-08-22T18:53:26Z")
The script to create one index is shown below. ### knowledgebaseproduct1 size: 1.69Gi (1.69Gi) docs: 3,204,295 (3,231,925) Currently using Nest 6.3.4 to handle all the queries and insert/update. We are doing a text search across one or many fields. We are looking for documents where the CompliFolderFolderNameCriteria contains or starts with specific words. Sometimes a search uses two fields eg: CompliFolderFolderNameCriteria & NameNumberAliasCriteria. The results set usually contains 3000 documents per search. The search can be done by many users (currently only about 5 users max), Data ingestion is done using logstash and pulls from SQL. Logstash runs daily at 6pm. And inserts or updates to any documents are handled real time. But maybe only 5000 insert/updates a day max. curl -XPUT [http://localhost:9200/knowledgebaseproduct1](http://localhost:9200/knowledgebaseproduct1) -H'Content-Type: application/json' -d '{ "settings": { "number\_of\_shards": 3, "number\_of\_replicas": 0, "analysis": { "char\_filter": { "removewhitespaces": { "type": "pattern\_replace", "pattern": "\s+", "replacement": "" } }, "filter": { "autocomplete\_filter": { "type": "edge\_ngram", "min\_gram": 1, "max\_gram": 30 }, "ngram\_filter": { "type": "ngram", "min\_gram": 2, "max\_gram": 3 }, "removesymbols": { "type": "pattern\_replace", "pattern": "[^A-Za-z0-9]", "replacement": "" } }, "analyzer": { "autocomplete": { "type": "custom", "tokenizer": "standard", "filter": [ "lowercase", "autocomplete\_filter" ] }, "ngram": { "type": "custom", "tokenizer": "standard", "filter": [ "lowercase", "ngram\_filter" ], "char\_filter": [ "removewhitespaces" ] }, "keyvalue": { "type": "custom", "tokenizer": "keyword", "filter": [ "lowercase", "asciifolding", "removesymbols" ], "char\_filter": [ "removewhitespaces" ] }, "basic": { "type": "custom", "tokenizer": "standard", "filter": [ "lowercase" ] } } } }, "mappings": { "doc": { "dynamic": "strict", "properties": { "CompliFolderCompliFolderIdCriteria":{ "type": "long" }, "CompliFolderCompanyIdCriteria": { "type": "long" }, "CompliFolderPhysicalStateLkpIdCriteria": { "type": "long" }, "CompliFolderStatusLkpIdCriteria":{ "type": "long" }, "ObtainmentActionsNoticeNumberCriteria":{ "type": "text", "fields": { "autocompletefield": { "type": "text", "analyzer": "autocomplete", "search\_analyzer": "standard" }, "ngramfield": { "type": "text", "analyzer": "ngram" }, "keyvaluefield": { "type": "text", "analyzer": "keyvalue" }, "basicfield": { "type": "text", "analyzer": "basic" } } }, "ObtainmentWorkItemContainsProductCriteria":{ "type": "long" }, "CompliFolderFolderNameCriteria": { "type": "text", "fields": { "autocompletefield": { "type": "text", "analyzer": "autocomplete", "search\_analyzer": "standard" }, "ngramfield": { "type": "text", "analyzer": "ngram" }, "keyvaluefield": { "type": "text", "analyzer": "keyvalue" }, "basicfield": { "type": "text", "analyzer": "basic" } } }, "NameNumberNameOrNumberCriteria": { "type": "text", "fields": { "autocompletefield": { "type": "text", "analyzer": "autocomplete", "search\_analyzer": "standard" }, "ngramfield": { "type": "text", "analyzer": "ngram" }, "keyvaluefield": { "type": "text", "analyzer": "keyvalue" }, "basicfield": { "type": "text", "analyzer": "basic" } } }, "NameNumberAliasCriteria": { "type": "text", "fields": { "autocompletefield": { "type": "text", "analyzer": "autocomplete", "search\_analyzer": "standard" }, "ngramfield": { "type": "text", "analyzer": "ngram" }, "keyvaluefield": { "type": "text", "analyzer": "keyvalue" }, "basicfield": { "type": "text", "analyzer": "basic" } } } } } } }' sleep 10 ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [August 22, 2018, 6:58pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/4 "2018-08-22T18:58:03Z")
Can you show the full output of the [cluster stats API](https://www.elastic.co/guide/en/elasticsearch/reference/6.3/cluster-stats.html)? ---
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 22, 2018, 10:02pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/5 "2018-08-22T22:02:15Z")
{ "\_nodes" : { "total" : 1, "successful" : 1, "failed" : 0 }, "cluster\_name" : "complielasticsearch", "nodes" : { "iU7a\_H4\_TMG6BFR6rITy4w" : { "timestamp" : 1534975291774, "name" : "CBDES02", "transport\_address" : "10.54.43.108:9300", "host" : "CBDES02.DEV.LOCAL", "ip" : "10.54.43.108:9300", "roles" : [ "master", "data", "ingest" ], "indices" : { "docs" : { "count" : 13686193, "deleted" : 31902 }, "store" : { "size\_in\_bytes" : 8281607051 }, "indexing" : { "index\_total" : 0, "index\_time\_in\_millis" : 0, "index\_current" : 0, "index\_failed" : 0, "delete\_total" : 0, "delete\_time\_in\_millis" : 0, "delete\_current" : 0, "noop\_update\_total" : 0, "is\_throttled" : false, "throttle\_time\_in\_millis" : 0 }, "get" : { "total" : 0, "time\_in\_millis" : 0, "exists\_total" : 0, "exists\_time\_in\_millis" : 0, "missing\_total" : 0, "missing\_time\_in\_millis" : 0, "current" : 0 }, "search" : { "open\_contexts" : 0, "query\_total" : 18, "query\_time\_in\_millis" : 145, "query\_current" : 0, "fetch\_total" : 0, "fetch\_time\_in\_millis" : 0, "fetch\_current" : 0, "scroll\_total" : 0, "scroll\_time\_in\_millis" : 0, "scroll\_current" : 0, "suggest\_total" : 0, "suggest\_time\_in\_millis" : 0, "suggest\_current" : 0 }, "merges" : { "current" : 0, "current\_docs" : 0, "current\_size\_in\_bytes" : 0, "total" : 0, "total\_time\_in\_millis" : 0, "total\_docs" : 0, "total\_size\_in\_bytes" : 0, "total\_stopped\_time\_in\_millis" : 0, "total\_throttled\_time\_in\_millis" : 0, "total\_auto\_throttle\_in\_bytes" : 377487360 }, "refresh" : { "total" : 127, "total\_time\_in\_millis" : 31, "listeners" : 0 }, "flush" : { "total" : 18, "total\_time\_in\_millis" : 1401 }, "warmer" : { "current" : 0, "total" : 54, "total\_time\_in\_millis" : 2 }, "query\_cache" : { "memory\_size\_in\_bytes" : 0, "total\_count" : 14, "hit\_count" : 0, "miss\_count" : 14, "cache\_size" : 0, "cache\_count" : 0, "evictions" : 0 }, "fielddata" : { "memory\_size\_in\_bytes" : 0, "evictions" : 0 }, "completion" : { "size\_in\_bytes" : 0 }, "segments" : { "count" : 269, "memory\_in\_bytes" : 47067957, "terms\_memory\_in\_bytes" : 44304116, "stored\_fields\_memory\_in\_bytes" : 1776536, "term\_vectors\_memory\_in\_bytes" : 0, "norms\_memory\_in\_bytes" : 300480, "points\_memory\_in\_bytes" : 595325, "doc\_values\_memory\_in\_bytes" : 91500, "index\_writer\_memory\_in\_bytes" : 0, "version\_map\_memory\_in\_bytes" : 0, "fixed\_bit\_set\_memory\_in\_bytes" : 0, "max\_unsafe\_auto\_id\_timestamp" : -1, "file\_sizes" : { } }, "translog" : { "operations" : 73, "size\_in\_bytes" : 80884, "uncommitted\_operations" : 0, "uncommitted\_size\_in\_bytes" : 774 }, "request\_cache" : { "memory\_size\_in\_bytes" : 5406, "evictions" : 0, "hit\_count" : 3, "miss\_count" : 6 }, "recovery" : { "current\_as\_source" : 0, "current\_as\_target" : 0, "throttle\_time\_in\_millis" : 0 } }, "os" : { "timestamp" : 1534975292055, "cpu" : { "percent" : 0 }, "mem" : { "total\_in\_bytes" : 17179398144, "free\_in\_bytes" : 1669337088, "used\_in\_bytes" : 15510061056, "free\_percent" : 10, "used\_percent" : 90 }, "swap" : { "total\_in\_bytes" : 17179398144, "free\_in\_bytes" : 1941716992, "used\_in\_bytes" : 15237681152 } }, "process" : { "timestamp" : 1534975292055, "open\_file\_descriptors" : -1, "max\_file\_descriptors" : -1, "cpu" : { "percent" : 0, "total\_in\_millis" : 38828 }, "mem" : { "total\_virtual\_in\_bytes" : 13396226048 } }, "jvm" : { "timestamp" : 1534975292055, "uptime\_in\_millis" : 601374, "mem" : { "heap\_used\_in\_bytes" : 226267408, "heap\_used\_percent" : 1, "heap\_committed\_in\_bytes" : 12850036736, "heap\_max\_in\_bytes" : 12850036736, "non\_heap\_used\_in\_bytes" : 77749000, "non\_heap\_committed\_in\_bytes" : 83845120, "pools" : { "young" : { "used\_in\_bytes" : 62786472, "max\_in\_bytes" : 279183360, "peak\_used\_in\_bytes" : 279183360, "peak\_max\_in\_bytes" : 279183360 }, "survivor" : { "used\_in\_bytes" : 34865152, "max\_in\_bytes" : 34865152, "peak\_used\_in\_bytes" : 34865152, "peak\_max\_in\_bytes" : 34865152 }, "old" : { "used\_in\_bytes" : 128615784, "max\_in\_bytes" : 12535988224, "peak\_used\_in\_bytes" : 128615784, "peak\_max\_in\_bytes" : 12535988224 } } }, "threads" : { "count" : 43, "peak\_count" : 43 }, "gc" : { "collectors" : { "young" : { "collection\_count" : 5, "collection\_time\_in\_millis" : 361 }, "old" : { "collection\_count" : 1, "collection\_time\_in\_millis" : 36 } } }, "buffer\_pools" : { "direct" : { "count" : 27, "used\_in\_bytes" : 50704899, "total\_capacity\_in\_bytes" : 50704898 }, "mapped" : { "count" : 593, "used\_in\_bytes" : 8248466860, "total\_capacity\_in\_bytes" : 8248466860 } }, "classes" : { "current\_loaded\_count" : 10882, "total\_loaded\_count" : 10882, "total\_unloaded\_count" : 0 } }, ---
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 22, 2018, 10:02pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/6 "2018-08-22T22:02:35Z")
"thread\_pool" : { "bulk" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "fetch\_shard\_started" : { "threads" : 1, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 8, "completed" : 18 }, "fetch\_shard\_store" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "flush" : { "threads" : 2, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 2, "completed" : 36 }, "force\_merge" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "generic" : { "threads" : 4, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 4, "completed" : 197 }, "get" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "index" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "listener" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "management" : { "threads" : 3, "queue" : 0, "active" : 1, "rejected" : 0, "largest" : 3, "completed" : 79 }, "refresh" : { "threads" : 2, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 2, "completed" : 3454 }, "search" : { "threads" : 7, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 7, "completed" : 24 }, "snapshot" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 }, "warmer" : { "threads" : 0, "queue" : 0, "active" : 0, "rejected" : 0, "largest" : 0, "completed" : 0 } }, ---
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 22, 2018, 10:02pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/7 "2018-08-22T22:02:48Z")
"fs" : { "timestamp" : 1534975292055, "total" : { "total\_in\_bytes" : 214221975552, "free\_in\_bytes" : 181595267072, "available\_in\_bytes" : 181595267072 }, "least\_usage\_estimate" : { "path" : "C:\ProgramData\Elastic\Elasticsearch\data\nodes\0", "total\_in\_bytes" : 214221975552, "available\_in\_bytes" : 181595267072, "used\_disk\_percent" : 15.230327512351892 }, "most\_usage\_estimate" : { "path" : "C:\ProgramData\Elastic\Elasticsearch\data\nodes\0", "total\_in\_bytes" : 214221975552, "available\_in\_bytes" : 181595267072, "used\_disk\_percent" : 15.230327512351892 }, "data" : [ { "path" : "C:\ProgramData\Elastic\Elasticsearch\data\nodes\0", "mount" : "(C:)", "type" : "NTFS", "total\_in\_bytes" : 214221975552, "free\_in\_bytes" : 181595267072, "available\_in\_bytes" : 181595267072 } ] }, "transport" : { "server\_open" : 0, "rx\_count" : 0, "rx\_size\_in\_bytes" : 0, "tx\_count" : 0, "tx\_size\_in\_bytes" : 0 }, "http" : { "current\_open" : 3, "total\_opened" : 6 }, "breakers" : { "request" : { "limit\_size\_in\_bytes" : 7710022041, "limit\_size" : "7.1gb", "estimated\_size\_in\_bytes" : 0, "estimated\_size" : "0b", "overhead" : 1.0, "tripped" : 0 }, "fielddata" : { "limit\_size\_in\_bytes" : 7710022041, "limit\_size" : "7.1gb", "estimated\_size\_in\_bytes" : 0, "estimated\_size" : "0b", "overhead" : 1.03, "tripped" : 0 }, "in\_flight\_requests" : { "limit\_size\_in\_bytes" : 12850036736, "limit\_size" : "11.9gb", "estimated\_size\_in\_bytes" : 0, "estimated\_size" : "0b", "overhead" : 1.0, "tripped" : 0 }, "accounting" : { "limit\_size\_in\_bytes" : 12850036736, "limit\_size" : "11.9gb", "estimated\_size\_in\_bytes" : 47067957, "estimated\_size" : "44.8mb", "overhead" : 1.0, "tripped" : 0 }, "parent" : { "limit\_size\_in\_bytes" : 8995025715, "limit\_size" : "8.3gb", "estimated\_size\_in\_bytes" : 47067957, "estimated\_size" : "44.8mb", "overhead" : 1.0, "tripped" : 0 } }, "script" : { "compilations" : 0, "cache\_evictions" : 0 }, "discovery" : { "cluster\_state\_queue" : { "total" : 0, "pending" : 0, "committed" : 0 }, "published\_cluster\_states" : { "full\_states" : 0, "incompatible\_diffs" : 0, "compatible\_diffs" : 0 } }, "ingest" : { "total" : { "count" : 0, "time\_in\_millis" : 0, "current" : 0, "failed" : 0 }, "pipelines" : { } }, "adaptive\_selection" : { "iU7a\_H4\_TMG6BFR6rITy4w" : { "outgoing\_searches" : 0, "avg\_queue\_size" : 0, "avg\_service\_time\_ns" : 2698838, "avg\_response\_time\_ns" : 3729506, "rank" : "3.7" } } } } } ---
**Author:** ![Sanj\_Gunetileke](https://avatars.discourse-cdn.com/v4/letter/s/8baadc/32.png) [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Post date:** [August 29, 2018, 4:53pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/8 "2018-08-29T16:53:29Z")
I found out what was causing this. Kibana was accessing this node. When kibana stopped connecting to this node the issues stopped. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 26, 2018, 4:53pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588/9 "2018-09-26T16:53:36Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.