# Bulk insert error?

**URL:** <https://discuss.elastic.co/t/bulk-insert-error/4078>\
**Category:** Elasticsearch\
**Created:** [March 10, 2011, 10:33pm UTC](https://discuss.elastic.co/t/bulk-insert-error/4078 "2011-03-10T22:33:58Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Matt\_Paul\_2](https://avatars.discourse-cdn.com/v4/letter/m/f19dbf/32.png) [@Matt\_Paul\_2](https://discuss.elastic.co/u/Matt_Paul_2)\
**Post date:** [March 10, 2011, 10:33pm UTC](https://discuss.elastic.co/t/bulk-insert-error/4078/1 "2011-03-10T22:33:58Z")

</div>

All,

I'm getting a strange error (this is from the elasticsearch log, I just get  
the out of bounds error back via the REST interface) when doing a number of  
large bulk inserts, any idea on what might possibly be causing this? It's on  
a create operation (and there definitely is a lot of data going in)

java.lang.ArrayIndexOutOfBoundsException  
at  
org.apache.lucene.analysis.standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java:442)  
at  
org.apache.lucene.analysis.standard.StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:649)  
at  
org.apache.lucene.analysis.standard.StandardTokenizer.incrementToken(StandardTokenizer.java:167)  
at  
org.apache.lucene.analysis.standard.StandardFilter.incrementToken(StandardFilter.java:50)  
at  
org.apache.lucene.analysis.LowerCaseFilter.incrementToken(LowerCaseFilter.java:37)  
at  
org.apache.lucene.analysis.StopFilter.incrementToken(StopFilter.java:141)  
at  
org.elasticsearch.common.lucene.all.AllTokenStream.incrementToken(AllTokenStream.java:56)  
at  
org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:188)  
at  
org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:246)  
at  
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:826)  
at  
org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:802)  
at  
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1998)  
at  
org.elasticsearch.index.engine.robin.RobinEngine.innerCreate(RobinEngine.java:305)  
at  
org.elasticsearch.index.engine.robin.RobinEngine.create(RobinEngine.java:229)  
at  
org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:264)  
at  
org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:139)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:418)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.access$100(TransportShardReplicationOperationAction.java:233)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:331)  
at  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)  
at  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)  
at java.lang.Thread.run(Thread.java:636)

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [March 11, 2011, 1:09pm UTC](https://discuss.elastic.co/t/bulk-insert-error/4078/2 "2011-03-11T13:09:11Z")

</div>

Which version are you using? I fixed a similar problem (related to the \_all field) in 0.15.2: [https://github.com/elasticsearch/elasticsearch/issues/closed#issue/743](https://github.com/elasticsearch/elasticsearch/issues/closed#issue/743).  
On Friday, March 11, 2011 at 12:33 AM, Matt Paul wrote:

> All,
> 
> I'm getting a strange error (this is from the elasticsearch log, I just get the out of bounds error back via the REST interface) when doing a number of large bulk inserts, any idea on what might possibly be causing this? It's on a create operation (and there definitely is a lot of data going in)
> 
> java.lang.ArrayIndexOutOfBoundsException  
> at org.apache.lucene.analysis.standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java:442)  
> at org.apache.lucene.analysis.standard.StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:649)  
> at org.apache.lucene.analysis.standard.StandardTokenizer.incrementToken(StandardTokenizer.java:167)  
> at org.apache.lucene.analysis.standard.StandardFilter.incrementToken(StandardFilter.java:50)  
> at org.apache.lucene.analysis.LowerCaseFilter.incrementToken(LowerCaseFilter.java:37)  
> at org.apache.lucene.analysis.StopFilter.incrementToken(StopFilter.java:141)  
> at org.elasticsearch.common.lucene.all.AllTokenStream.incrementToken(AllTokenStream.java:56)  
> at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:188)  
> at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:246)  
> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:826)  
> at org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:802)  
> at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1998)  
> at org.elasticsearch.index.engine.robin.RobinEngine.innerCreate(RobinEngine.java:305)  
> at org.elasticsearch.index.engine.robin.RobinEngine.create(RobinEngine.java:229)  
> at org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:264)  
> at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:139)  
> at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:418)  
> at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.access$100(TransportShardReplicationOperationAction.java:233)  
> at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:331)  
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)  
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)  
> at java.lang.Thread.run(Thread.java:636)

---

<div class="post-metadata">

**Author:** ![Matt\_Paul\_2](https://avatars.discourse-cdn.com/v4/letter/m/f19dbf/32.png) [@Matt\_Paul\_2](https://discuss.elastic.co/u/Matt_Paul_2)\
**Post date:** [March 11, 2011, 2:32pm UTC](https://discuss.elastic.co/t/bulk-insert-error/4078/3 "2011-03-11T14:32:14Z")

</div>

Shay,

I've been using a build from source that I downloaded on 3/1 (It was  
the first version that had the fix to my has\_child facet issue, #730).  
I'll download the latest and give that a try and let you know, thanks!

Matt

On Mar 11, 7:09 am, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:

> Which version are you using? I fixed a similar problem (related to the \_all field) in 0.15.2:[Issues · elastic/elasticsearch · GitHub](https://github.com/elasticsearch/elasticsearch/issues/closed#issue/743).
> 
> On Friday, March 11, 2011 at 12:33 AM, Matt Paul wrote:
> 
> > All,
> 
> > I'm getting a strange error (this is from the elasticsearch log, I just get the out of bounds error back via the REST interface) when doing a number of large bulk inserts, any idea on what might possibly be causing this? It's on a create operation (and there definitely is a lot of data going in)
> 
> > java.lang.ArrayIndexOutOfBoundsException  
> > at org.apache.lucene.analysis.standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java:442)  
> > at org.apache.lucene.analysis.standard.StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:649)  
> > at org.apache.lucene.analysis.standard.StandardTokenizer.incrementToken(StandardTokenizer.java:167)  
> > at org.apache.lucene.analysis.standard.StandardFilter.incrementToken(StandardFilter.java:50)  
> > at org.apache.lucene.analysis.LowerCaseFilter.incrementToken(LowerCaseFilter.java:37)  
> > at org.apache.lucene.analysis.StopFilter.incrementToken(StopFilter.java:141)  
> > at org.elasticsearch.common.lucene.all.AllTokenStream.incrementToken(AllTokenStream.java:56)  
> > at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:188)  
> > at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:246)  
> > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:826)  
> > at org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:802)  
> > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1998)  
> > at org.elasticsearch.index.engine.robin.RobinEngine.innerCreate(RobinEngine.java:305)  
> > at org.elasticsearch.index.engine.robin.RobinEngine.create(RobinEngine.java:229)  
> > at org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:264)  
> > at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:139)  
> > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:418)  
> > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.access$100(TransportShardReplicationOperationAction.java:233)  
> > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:331)  
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)  
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)  
> > at java.lang.Thread.run(Thread.java:636)

---

<div class="post-metadata">

**Author:** ![Matt\_Paul\_2](https://avatars.discourse-cdn.com/v4/letter/m/f19dbf/32.png) [@Matt\_Paul\_2](https://discuss.elastic.co/u/Matt_Paul_2)\
**Post date:** [March 11, 2011, 3:34pm UTC](https://discuss.elastic.co/t/bulk-insert-error/4078/4 "2011-03-11T15:34:03Z")

</div>

Shay,

I downloaded the latest snapshot and that did indeed fix my issue,  
thanks!

Matt

On Mar 11, 8:32 am, Matt Paul [purplegher...@gmail.com](mailto:purplegher...@gmail.com) wrote:

> Shay,
> 
> I've been using a build from source that I downloaded on 3/1 (It was  
> the first version that had the fix to my has\_child facet issue, #730).  
> I'll download the latest and give that a try and let you know, thanks!
> 
> Matt
> 
> On Mar 11, 7:09 am, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:
> 
> > Which version are you using? I fixed a similar problem (related to the \_all field) in 0.15.2:[Issues · elastic/elasticsearch · GitHub](https://github.com/elasticsearch/elasticsearch/issues/closed#issue/743).
> 
> > On Friday, March 11, 2011 at 12:33 AM, Matt Paul wrote:
> > 
> > > All,
> 
> > > I'm getting a strange error (this is from the elasticsearch log, I just get the out of bounds error back via the REST interface) when doing a number of large bulk inserts, any idea on what might possibly be causing this? It's on a create operation (and there definitely is a lot of data going in)
> 
> > > java.lang.ArrayIndexOutOfBoundsException  
> > > at org.apache.lucene.analysis.standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java:442)  
> > > at org.apache.lucene.analysis.standard.StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:649)  
> > > at org.apache.lucene.analysis.standard.StandardTokenizer.incrementToken(StandardTokenizer.java:167)  
> > > at org.apache.lucene.analysis.standard.StandardFilter.incrementToken(StandardFilter.java:50)  
> > > at org.apache.lucene.analysis.LowerCaseFilter.incrementToken(LowerCaseFilter.java:37)  
> > > at org.apache.lucene.analysis.StopFilter.incrementToken(StopFilter.java:141)  
> > > at org.elasticsearch.common.lucene.all.AllTokenStream.incrementToken(AllTokenStream.java:56)  
> > > at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:188)  
> > > at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:246)  
> > > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:826)  
> > > at org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:802)  
> > > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1998)  
> > > at org.elasticsearch.index.engine.robin.RobinEngine.innerCreate(RobinEngine.java:305)  
> > > at org.elasticsearch.index.engine.robin.RobinEngine.create(RobinEngine.java:229)  
> > > at org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:264)  
> > > at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:139)  
> > > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:418)  
> > > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.access$100(TransportShardReplicationOperationAction.java:233)  
> > > at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:331)  
> > > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)  
> > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)  
> > > at java.lang.Thread.run(Thread.java:636)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:10am UTC](https://discuss.elastic.co/t/bulk-insert-error/4078/5 "2017-07-06T04:10:15Z")

</div>