# Elasticsearch increase total\_in\_bytes value Memory **URL:** \ **Category:** Elasticsearch\ **Created:** [December 6, 2022, 12:32pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578 "2022-12-06T12:32:15Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 12:32pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/1 "2022-12-06T12:32:15Z")
Hello I'm running a single node on an Ubuntu machine. Currently I have not enough space on my node. > ``` > "mem" : { > "total_in_bytes" : 25217441792, > "free_in_bytes" : 674197504, > "used_in_bytes" : 24543244288, > "free_percent" : 3, > "used_percent" : 97 > } > > ``` On the other hand when I execute the command df -h , I see that I still have enough space on the Linux server ``` Filesystem Size Used Avail Use% Mounted on udev 12G 12G 0 100% /dev tmpfs 2,4G 1,5M 2,4G 1% /run /dev/mapper/ubuntu--vg-ubuntu--lv 158G 110G 42G 73% / ***<=====*** tmpfs 12G 0 12G 0% /dev/shm tmpfs 5,0M 0 5,0M 0% /run/lock tmpfs 12G 0 12G 0% /sys/fs/cgroup /dev/sda2 974M 304M 603M 34% /boot /dev/mapper/ubuntu--vg-lv--opt 206G 70G 127G 36% /opt ***<=======*** tmpfs 2,4G 0 2,4G 0% /run/user/1000 /dev/loop0 64M 64M 0 100% /snap/core20/1634 /dev/loop10 56M 56M 0 100% /snap/core18/2620 /dev/loop8 64M 64M 0 100% /snap/core20/1695 /dev/loop2 56M 56M 0 100% /snap/core18/2632 /dev/loop7 92M 92M 0 100% /snap/lxd/23991 /dev/loop3 50M 50M 0 100% /snap/snapd/17883 /dev/loop4 92M 92M 0 100% /snap/lxd/24061 ``` Please how can I increase the value of total\_in\_bytes ? Thanks. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 12:33pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/2 "2022-12-06T12:33:50Z")
Welcome! `mem.*` refers to memory and not filesystem. So I'm not sure to understand your question. ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 12:37pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/3 "2022-12-06T12:37:58Z")
Hello @dadoonet , I just want to increase the node size. when I check the disk space on the server I see that there is still space left, I want to use this space for my node ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 1:33pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/4 "2022-12-06T13:33:43Z")
Elasticsearch will use all the disk space which is available in your `data` dir. So if your `data` dir is within `/opt`, it will try to use the 70G available space if needed. ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 1:47pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/5 "2022-12-06T13:47:23Z")
I don't understand why it's not working for me. data is stored in Opt as shown below for Opt there is 127GB free on the other hand, the node tells me that there is only 3% free ```auto "data" : [ { "path" : "/opt/Elastic/elasticsearch-7.14.0/data/nodes/0", "mount" : "/opt (/dev/mapper/ubuntu--vg-lv--opt)", "type" : "ext4", "total_in_bytes" : 220810428416, "free_in_bytes" : 146589724672, "available_in_bytes" : 135298658304 } ] ``` ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 2:01pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/6 "2022-12-06T14:01:21Z")
The node reports that almost 127gb are available. ``` 135298658304 ``` So what's the problem? **What** is not working? ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 2:09pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/7 "2022-12-06T14:09:28Z")
> [@dadoonet](#): > > **What** is not working? I want to do a \_reindex , but the operation stops before it ends. when I check the status of the node, it tells me that there's just 3% free > ``` > "mem" : { > "total_in_bytes" : 25217441792, > "free_in_bytes" : 847118336, > "used_in_bytes" : 24370323456, > "free_percent" : 3, > "used_percent" : 97 > } > > ``` Can you help me please ? ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 2:58pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/8 "2022-12-06T14:58:42Z")
> [@b\_Ensberg](#): > > I want to do a \_reindex , but the operation stops before it ends. So how do you know there's a problem with disk space? > [@b\_Ensberg](#): > > Can you help me please ? Yeah. Please share the elasticsearch logs. That's probably indicates something. Also, which exact command are you running to reindex your data? Please share anything that would help us to help you... ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 3:36pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/9 "2022-12-06T15:36:13Z")
> [@dadoonet](#): > > So how do you know there's a problem with disk space? because Elastic tells me that I only have 3% free space left, that's not normal, is it? for the reindex, i used this command > POST \_reindex?wait\_for\_completion=false > { > "source": { > "index": "idx\_siv" > }, > "dest": { > "index": "siv3" > } > } and this is the log file ```auto [2022-12-06T01:16:33,501][WARN][r.suppressed] [node-1] path: /idx_siv/_search, params: {pretty=true, index=idx_siv} java.lang.IllegalStateException: Can't get text on a START_ARRAY at 4:17 at org.elasticsearch.common.xcontent.json.JsonXContentParser.text(JsonXContentParser.java:74) ~[elasticsearch-x-content-7.14.0.jar:7.14.0] at org.elasticsearch.common.xcontent.json.JsonXContentParser.objectText(JsonXContentParser.java:96) ~[elasticsearch-x-content-7.14.0.jar:7.14.0] at org.elasticsearch.index.query.MatchQueryBuilder.fromXContent(MatchQueryBuilder.java:527) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.search.SearchModule.lambda$registerQuery$17(SearchModule.java:975) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.common.xcontent.NamedXContentRegistry.parseNamedObject(NamedXContentRegistry.java:128) ~[elasticsearch-x-content-7.14.0.jar:7.14.0] at org.elasticsearch.common.xcontent.support.AbstractXContentParser.namedObject(AbstractXContentParser.java:398) ~[elasticsearch-x-content-7.14.0.jar:7.14.0] at org.elasticsearch.index.query.AbstractQueryBuilder.parseInnerQueryBuilder(AbstractQueryBuilder.java:309) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.index.query.AbstractQueryBuilder.parseInnerQueryBuilder(AbstractQueryBuilder.java:286) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.search.builder.SearchSourceBuilder.parseXContent(SearchSourceBuilder.java:1204) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.action.search.RestSearchAction.parseSearchRequest(RestSearchAction.java:139) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.action.search.RestSearchAction.lambda$prepareRequest$1(RestSearchAction.java:114) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.RestRequest.withContentOrSourceParamParserOrNull(RestRequest.java:471) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.action.search.RestSearchAction.prepareRequest(RestSearchAction.java:113) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:83) ~[elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:98) ~[?:?] at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:274) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:356) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:195) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:451) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:516) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:378) [elasticsearch-7.14.0.jar:7.14.0] at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:31) [transport-netty4-client-7.14.0.jar:7.14.0] at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:17) [transport-netty4-client-7.14.0.jar:7.14.0] at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:47) [transport-netty4-client-7.14.0.jar:7.14.0] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final] at java.lang.Thread.run(Thread.java:831) [?:?] [2022-12-06T01:20:56,025][WARN][r.suppressed] [node-1] path: /idx_siv/_search, params: {pretty=true, index=idx_siv} java.lang.IllegalStateException: Can't get text on a START_ARRAY at 4:17 ``` Thank you again ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 4:59pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/10 "2022-12-06T16:59:09Z")
Please format your code, logs or configuration files using `` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable. > [@b\_Ensberg](#): > > because Elastic tells me that I only have 3% free space left, that's not normal, is it? Where Elastic is telling you that? Could you tell? About the logs, it seems to indicate that at least one of you document in the index is not really readable (not a correct JSON)... Not related to a disk space issue or whatever else. Could you run: ``` GET /idx_siv/_search?size=10000 ``` To see if you can reproduce that? What is the output of: ``` GET /_cat/indices/idx_siv?v ``` ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 6, 2022, 5:11pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/11 "2022-12-06T17:11:22Z")
> [@dadoonet](#): > > Where Elastic is telling you that? Could you tell? when i run this command `GET /_nodes/stats` i get : "free\_percent" : 3 in "meme" ==\> Percentage of free memory ```auto "mem" : { "total_in_bytes" : 25217441792, "free_in_bytes" : 674197504, "used_in_bytes" : 24543244288, "free_percent" : 3, "used_percent" : 97 } ``` yes when i run `GET /idx_siv/_search?size=10000` i get a documents What is the output of: ```auto GET /_cat/indices/idx_siv?v ``` ```auto health status index uuid pri rep docs.count docs.deleted store.size pri.store.size yellow open idx_siv idFu6PLLT3SI4YAjgNA_Ig 1 1 103562064 5574757 58.5gb 58.5gb ``` Thank you ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 6, 2022, 11:14pm UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/12 "2022-12-06T23:14:57Z")
> [@b\_Ensberg](#): > > i get : "free\_percent" : 3 in "meme" ==\> Percentage of free memory I'm going to tell it one more time in case it's unclear: RAM is not Disk Space. Anyway, it sounds like that one of your documents is incorrect. Not sure how this happened. My recommendation though: - upgrade to the latest 7.17 version - if possible split the reindex operation into multiple ones using a query. You will have more chance to find which one is not working vs stopping the whole process... ---
**Author:** ![b\_Ensberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/b_ensberg/32/114291_2.png) [@b\_Ensberg](https://discuss.elastic.co/u/b_Ensberg)\ **Post date:** [December 7, 2022, 9:20am UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/13 "2022-12-07T09:20:19Z")
Hello ; Thank you for your feedback, I have already made a script to write by blocks, but here it is an index with more than 250 Millions documents, it will probably take several days. Please, is there a way to delete all invalid documents or at least ingore them? I tried with this, but it didn't work ```auto POST _reindex?wait_for_completion=false { "conflicts": "proceed", "source": { "index": "idx1" }, "dest": { "index": "idx3" } } ``` Thanks ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 7, 2022, 10:13am UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/14 "2022-12-07T10:13:09Z")
I don't even know how this could happen to be honest... It might be a bug that has been fixed in most recent version. That's why I'd recommend upgrading... What you could try to do is to run otherwise a scroll script which iterates over all the data you have and for each hit, try to parse the `_source` using `jq` or similar. If it fails, print the document `_id`. My 2 cents. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 4, 2023, 10:13am UTC](https://discuss.elastic.co/t/elasticsearch-increase-total-in-bytes-value-memory/320578/15 "2023-01-04T10:13:23Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.