Error in bulk indexing - this IndexWriter is closed

Elastic Stack Elasticsearch
1

Hi,

We are indexing documents into elasticsearch from a java application.
We are unable to index all the required docs as indexing fails for some of
them due to following exception(found from log)

org.elasticsearch.index.engine.CreateFailedEngineException:
[investigations][0] Create failed for [Event#jEbSeiQASEemf6xTHSaUZw]
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:397)
at
org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:382)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:401)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:153)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter
is closed
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645)
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659)
at
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1525)
at
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1199)
at
org.elasticsearch.index.engine.internal.InternalEngine.innerCreate(InternalEngine.java:462)
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:384)

What could be the issue? This happens even if the number of documents being
indexed is as low as 28 and none of them is too big in size.

Regards,
Preeti

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

What ES version do you use?
How many nodes do you have in the cluster?
What is the replica level?

You are not required to use replica level in bulk action, you can add
replica afterwards.

Jörg

On Mon, Mar 24, 2014 at 6:10 AM, Preeti Jain itspreeti@gmail.com wrote:

Hi,

We are indexing documents into elasticsearch from a java application.
We are unable to index all the required docs as indexing fails for some of
them due to following exception(found from log)

org.elasticsearch.index.engine.CreateFailedEngineException:
[investigations][0] Create failed for [Event#jEbSeiQASEemf6xTHSaUZw]
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:397)
at
org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:382)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:401)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:153)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.lucene.store.AlreadyClosedException: this
IndexWriter is closed
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645)
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659)
at
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1525)
at
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1199)
at
org.elasticsearch.index.engine.internal.InternalEngine.innerCreate(InternalEngine.java:462)
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:384)

What could be the issue? This happens even if the number of documents
being indexed is as low as 28 and none of them is too big in size.

Regards,
Preeti

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGSoUdDb7VZaq__a7pGUR%2BiX%2B7oiPxnws-djuBUmBM8HQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

ES version is 1.0.1.
We have a single node cluster with shard and replica settings set to
default values(5 and 1 respectively)

Regards,
Preeti

On Monday, March 24, 2014 1:57:49 PM UTC+5:30, Jörg Prante wrote:

What ES version do you use?
How many nodes do you have in the cluster?
What is the replica level?

You are not required to use replica level in bulk action, you can add
replica afterwards.

Jörg

On Mon, Mar 24, 2014 at 6:10 AM, Preeti Jain <itsp...@gmail.com<javascript:>

wrote:

Hi,

We are indexing documents into elasticsearch from a java application.
We are unable to index all the required docs as indexing fails for some
of them due to following exception(found from log)

org.elasticsearch.index.engine.CreateFailedEngineException:
[investigations][0] Create failed for [Event#jEbSeiQASEemf6xTHSaUZw]
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:397)
at
org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:382)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:401)
at
org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:153)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.lucene.store.AlreadyClosedException: this
IndexWriter is closed
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645)
at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659)
at
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1525)
at
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1199)
at
org.elasticsearch.index.engine.internal.InternalEngine.innerCreate(InternalEngine.java:462)
at
org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:384)

What could be the issue? This happens even if the number of documents
being indexed is as low as 28 and none of them is too big in size.

Regards,
Preeti

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7b8b4691-e5b0-46d0-b660-54a110ffb14e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

4

Check if error still pertains with replica level 0. On single node, there
is not much sense in replica level 1.

Jörg

On Mon, Mar 24, 2014 at 9:59 AM, Preeti Jain itspreeti@gmail.com wrote:

ES version is 1.0.1.
We have a single node cluster with shard and replica settings set to
default values(5 and 1 respectively)

Regards,
Preeti

On Monday, March 24, 2014 1:57:49 PM UTC+5:30, Jörg Prante wrote:

What ES version do you use?
How many nodes do you have in the cluster?
What is the replica level?

You are not required to use replica level in bulk action, you can add
replica afterwards.

Jörg

On Mon, Mar 24, 2014 at 6:10 AM, Preeti Jain itsp...@gmail.com wrote:

Hi,

We are indexing documents into elasticsearch from a java application.
We are unable to index all the required docs as indexing fails for some
of them due to following exception(found from log)

org.elasticsearch.index.engine.CreateFailedEngineException:
[investigations][0] Create failed for [Event#jEbSeiQASEemf6xTHSaUZw]
at org.elasticsearch.index.engine.internal.
InternalEngine.create(InternalEngine.java:397)
at org.elasticsearch.index.shard.service.InternalIndexShard.
create(InternalIndexShard.java:382)
at org.elasticsearch.action.bulk.TransportShardBulkAction.
shardIndexOperation(TransportShardBulkAction.java:401)
at org.elasticsearch.action.bulk.TransportShardBulkAction.
shardOperationOnPrimary(TransportShardBulkAction.java:153)
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction.
performOnPrimary(TransportShardReplicationOperationAction.java:556)
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction$1.
run(TransportShardReplicationOperationAction.java:426)
at java.util.concurrent.ThreadPoolExecutor$Worker.
runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.lucene.store.AlreadyClosedException: this
IndexWriter is closed
at org.apache.lucene.index.IndexWriter.ensureOpen(
IndexWriter.java:645)
at org.apache.lucene.index.IndexWriter.ensureOpen(
IndexWriter.java:659)
at org.apache.lucene.index.IndexWriter.updateDocument(
IndexWriter.java:1525)
at org.apache.lucene.index.IndexWriter.addDocument(
IndexWriter.java:1199)
at org.elasticsearch.index.engine.internal.
InternalEngine.innerCreate(InternalEngine.java:462)
at org.elasticsearch.index.engine.internal.
InternalEngine.create(InternalEngine.java:384)

What could be the issue? This happens even if the number of documents
being indexed is as low as 28 and none of them is too big in size.

Regards,
Preeti

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%
40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7b8b4691-e5b0-46d0-b660-54a110ffb14e%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/7b8b4691-e5b0-46d0-b660-54a110ffb14e%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHOz%3DEJfaBKPLGKe2EwUF8BjU-3cTC7wEsUfskp%2BwCtTw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

5

Getting the same error with replica level set to 0.

Regards,
Preeti
On Monday, March 24, 2014 2:33:52 PM UTC+5:30, Jörg Prante wrote:

Check if error still pertains with replica level 0. On single node, there
is not much sense in replica level 1.

Jörg

On Mon, Mar 24, 2014 at 9:59 AM, Preeti Jain <itsp...@gmail.com<javascript:>

wrote:

ES version is 1.0.1.
We have a single node cluster with shard and replica settings set to
default values(5 and 1 respectively)

Regards,
Preeti

On Monday, March 24, 2014 1:57:49 PM UTC+5:30, Jörg Prante wrote:

What ES version do you use?
How many nodes do you have in the cluster?
What is the replica level?

You are not required to use replica level in bulk action, you can add
replica afterwards.

Jörg

On Mon, Mar 24, 2014 at 6:10 AM, Preeti Jain itsp...@gmail.com wrote:

Hi,

We are indexing documents into elasticsearch from a java application.
We are unable to index all the required docs as indexing fails for some
of them due to following exception(found from log)

org.elasticsearch.index.engine.CreateFailedEngineException:
[investigations][0] Create failed for [Event#jEbSeiQASEemf6xTHSaUZw]
at org.elasticsearch.index.engine.internal.
InternalEngine.create(InternalEngine.java:397)
at org.elasticsearch.index.shard.service.InternalIndexShard.
create(InternalIndexShard.java:382)
at org.elasticsearch.action.bulk.TransportShardBulkAction.
shardIndexOperation(TransportShardBulkAction.java:401)
at org.elasticsearch.action.bulk.TransportShardBulkAction.
shardOperationOnPrimary(TransportShardBulkAction.java:153)
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction.
performOnPrimary(TransportShardReplicationOperationAction.java:556)
at org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$AsyncShardOperationAction$1.
run(TransportShardReplicationOperationAction.java:426)
at java.util.concurrent.ThreadPoolExecutor$Worker.
runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.lucene.store.AlreadyClosedException: this
IndexWriter is closed
at org.apache.lucene.index.IndexWriter.ensureOpen(
IndexWriter.java:645)
at org.apache.lucene.index.IndexWriter.ensureOpen(
IndexWriter.java:659)
at org.apache.lucene.index.IndexWriter.updateDocument(
IndexWriter.java:1525)
at org.apache.lucene.index.IndexWriter.addDocument(
IndexWriter.java:1199)
at org.elasticsearch.index.engine.internal.
InternalEngine.innerCreate(InternalEngine.java:462)
at org.elasticsearch.index.engine.internal.
InternalEngine.create(InternalEngine.java:384)

What could be the issue? This happens even if the number of documents
being indexed is as low as 28 and none of them is too big in size.

Regards,
Preeti

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%
40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/3276bee9-d94e-42a5-9df4-6c895f293dc7%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7b8b4691-e5b0-46d0-b660-54a110ffb14e%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/7b8b4691-e5b0-46d0-b660-54a110ffb14e%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8c62bb94-2aad-4419-bfc8-4e05657ff2c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

6

I'm curious, do these errors occur at the end of the bulk (i.e. the last
documents) or randomly in between/anywhere in the bulk?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9f5f0c7e-73cb-4eb4-80f9-fce9b5ff007d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.