Java.lang.OutOfMemoryError: Java heap space

Hi, i am new to elasticsearch. I have tried to store mails in
Elasticsearch. but for some mail which are big i am getting error, and my
code is crashing. I am getting the following error:

[message_owned_v1][1] Index failed for
[message#029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
org.elasticsearch.index.engine.IndexFailedEngineException:
[message_owned_v1][1] Index failed for
[message#029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
at
org.elasticsearch.index.engine.internal.InternalEngine.index(InternalEngine.java:499)
~[elasticsearch-1.3.2.jar:na]
at
org.elasticsearch.index.shard.service.InternalIndexShard.index(InternalIndexShard.java:409)
~[elasticsearch-1.3.2.jar:na]
at
org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:195)
~[elasticsearch-1.3.2.jar:na]
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:522)
~[elasticsearch-1.3.2.jar:na]
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:421)
~[elasticsearch-1.3.2.jar:na]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_31]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_31]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
Caused by: java.lang.OutOfMemoryError: Java heap space

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

How much RAM and heap have you assigned things?

On 24 February 2015 at 15:14, Shohedul Hasan shakil@qianalysis.com wrote:

Hi, i am new to elasticsearch. I have tried to store mails in
Elasticsearch. but for some mail which are big i am getting error, and my
code is crashing. I am getting the following error:

[message_owned_v1][1] Index failed for [message#
029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea400
00_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
org.elasticsearch.index.engine.IndexFailedEngineException:
[message_owned_v1][1] Index failed for [message#
029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea400
00_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
at org.elasticsearch.index.engine.internal.InternalEngine.index(InternalEngine.java:499)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.index.shard.service.InternalIndexShard.
index(InternalIndexShard.java:409) ~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.index.TransportIndexAction.
shardOperationOnPrimary(TransportIndexAction.java:195)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction.
performOnPrimary(TransportShardReplicationOperationAction.java:522)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(
TransportShardReplicationOperationAction.java:421)
~[elasticsearch-1.3.2.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_31]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_31]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
Caused by: java.lang.OutOfMemoryError: Java heap space

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8rOou%3DNH5m5%2BjfBH882UWKLNV6gNKzz6b%3Dv0BghZYJ5A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Hi, I have 12GB Ram, also I tried 10GB heap space. but With higher Heap
space the error is coming fast.

On Tuesday, February 24, 2015 at 2:17:55 PM UTC+6, Mark Walkom wrote:

How much RAM and heap have you assigned things?

On 24 February 2015 at 15:14, Shohedul Hasan <sha...@qianalysis.com
<javascript:>> wrote:

Hi, i am new to elasticsearch. I have tried to store mails in
Elasticsearch. but for some mail which are big i am getting error, and my
code is crashing. I am getting the following error:

[message_owned_v1][1] Index failed for [message#
029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea400
00_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
org.elasticsearch.index.engine.IndexFailedEngineException:
[message_owned_v1][1] Index failed for [message#
029f49b7deac406088b81ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea400
00_f1090e77-5f1e-444a-bfde-fb9ee4eb4c38]
at org.elasticsearch.index.engine.internal.InternalEngine.index(InternalEngine.java:499)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.index.shard.service.InternalIndexShard.
index(InternalIndexShard.java:409) ~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.index.TransportIndexAction.
shardOperationOnPrimary(TransportIndexAction.java:195)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction.
performOnPrimary(TransportShardReplicationOperationAction.java:522)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(
TransportShardReplicationOperationAction.java:421)
~[elasticsearch-1.3.2.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_31]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_31]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
Caused by: java.lang.OutOfMemoryError: Java heap space

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b4fddb51-6260-444b-9a98-077093848723%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Then you probably have too much data for your cluster.

How many indices, how many shards per index, how many nodes, how many GB of
data is it, what ES and java version and release are you running.

On 26 February 2015 at 16:09, Shohedul Hasan shakil@qianalysis.com wrote:

Hi, I have 12GB Ram, also I tried 10GB heap space. but With higher Heap
space the error is coming fast.

On Tuesday, February 24, 2015 at 2:17:55 PM UTC+6, Mark Walkom wrote:

How much RAM and heap have you assigned things?

On 24 February 2015 at 15:14, Shohedul Hasan sha...@qianalysis.com
wrote:

Hi, i am new to elasticsearch. I have tried to store mails in
Elasticsearch. but for some mail which are big i am getting error, and my
code is crashing. I am getting the following error:

[message_owned_v1][1] Index failed for [message#029f49b7deac406088b81
ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-
fb9ee4eb4c38]
org.elasticsearch.index.engine.IndexFailedEngineException:
[message_owned_v1][1] Index failed for [message#029f49b7deac406088b81
ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-
fb9ee4eb4c38]
at org.elasticsearch.index.engine.internal.InternalEngine.index(InternalEngine.java:499)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.index.shard.service.InternalIndexShard.ind
ex(InternalIndexShard.java:409) ~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.index.TransportIndexAction.shardOpe
rationOnPrimary(TransportIndexAction.java:195)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.TransportShardR
eplicationOperationAction$AsyncShardOperationAction.performOnPrimary(
TransportShardReplicationOperationAction.java:522)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.TransportShardR
eplicationOperationAction$AsyncShardOperationAction$1.run(Tr
ansportShardReplicationOperationAction.java:421)
~[elasticsearch-1.3.2.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_31]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_31]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
Caused by: java.lang.OutOfMemoryError: Java heap space

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/b4fddb51-6260-444b-9a98-077093848723%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/b4fddb51-6260-444b-9a98-077093848723%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_AFc6Jx-Wzkv-xck-ByLCsGmPKiD4x7nAZL6SFaWGOGg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

I am using only one index ,5 shards, the problem is i have tried with only
one mail which is 10MB . Still it's causing the error. I created another
mail which is 15MB but that is working. Why some particular documents
cause error where some bigger document don't.

On Thursday, February 26, 2015 at 12:12:05 PM UTC+6, Mark Walkom wrote:

Then you probably have too much data for your cluster.

How many indices, how many shards per index, how many nodes, how many GB
of data is it, what ES and java version and release are you running.

On 26 February 2015 at 16:09, Shohedul Hasan <sha...@qianalysis.com
<javascript:>> wrote:

Hi, I have 12GB Ram, also I tried 10GB heap space. but With higher Heap
space the error is coming fast.

On Tuesday, February 24, 2015 at 2:17:55 PM UTC+6, Mark Walkom wrote:

How much RAM and heap have you assigned things?

On 24 February 2015 at 15:14, Shohedul Hasan sha...@qianalysis.com
wrote:

Hi, i am new to elasticsearch. I have tried to store mails in
Elasticsearch. but for some mail which are big i am getting error, and my
code is crashing. I am getting the following error:

[message_owned_v1][1] Index failed for [message#029f49b7deac406088b81
ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-
fb9ee4eb4c38]
org.elasticsearch.index.engine.IndexFailedEngineException:
[message_owned_v1][1] Index failed for [message#029f49b7deac406088b81
ddeb6a4c0df_ff8081814bb4af0e014bb4af0ea40000_f1090e77-5f1e-444a-bfde-
fb9ee4eb4c38]
at org.elasticsearch.index.engine.internal.InternalEngine.index(InternalEngine.java:499)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.index.shard.service.InternalIndexShard.ind
ex(InternalIndexShard.java:409) ~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.index.TransportIndexAction.shardOpe
rationOnPrimary(TransportIndexAction.java:195)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.TransportShardR
eplicationOperationAction$AsyncShardOperationAction.performOnPrimary(
TransportShardReplicationOperationAction.java:522)
~[elasticsearch-1.3.2.jar:na]
at org.elasticsearch.action.support.replication.TransportShardR
eplicationOperationAction$AsyncShardOperationAction$1.run(Tr
ansportShardReplicationOperationAction.java:421)
~[elasticsearch-1.3.2.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_31]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_31]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
Caused by: java.lang.OutOfMemoryError: Java heap space

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/618d69ef-57c5-4541-b02d-d79d9d002d45%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/b4fddb51-6260-444b-9a98-077093848723%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/b4fddb51-6260-444b-9a98-077093848723%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/85455fdf-9468-4108-9717-453a68dee147%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.