# Bulk update times out **URL:** \ **Category:** Elasticsearch\ **Created:** [July 12, 2010, 12:13am UTC](https://discuss.elastic.co/t/bulk-update-times-out/3085 "2010-07-12T00:13:14Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Stephen\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephen_2/32/3274_2.png) [@Stephen\_2](https://discuss.elastic.co/u/Stephen_2)\ **Post date:** [July 12, 2010, 12:13am UTC](https://discuss.elastic.co/t/bulk-update-times-out/3085/1 "2010-07-12T00:13:14Z")
Hey guys, Was wondering if you guys could help me -- I've got a single elasticsearch node running 0.8 and am using the Java API to index a bunch of documents. I've got around 40 separate collections of data and spawn threads to index 10 at a time the first time my app starts up with no indexes present. Sadly, during the middle of all this the search server inevitably times out on one or more indexes, causing corruption. Here's a sample of what goes on in my logs: 2010-07-11 18:53:50,604 ERROR service.BaseSearchService$5 - [pool-1- thread-8] Error indexing card kdtgxj org.elasticsearch.action.PrimaryNotStartedActionException: [board.user1][0] Timeout waiting for [1m] at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction $AsyncShardOperationAction $4.onTimeout(TransportShardReplicationOperationAction.java:311) at org.elasticsearch.cluster.service.InternalClusterService $1$1.run(InternalClusterService.java:87) at java.util.concurrent.ThreadPoolExecutor $Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor $Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:637) 2010-07-11 18:53:50,605 INFO service.ElasticSearchService - [pool-1- thread-8] Rebuilding index for vinntestboard.vinn01/In Process... 2010-07-11 18:53:50,604 ERROR service.BaseSearchService$5 - [pool-1- thread-5] Error indexing card kwzjds org.elasticsearch.action.PrimaryNotStartedActionException: [board2.user2][1] Timeout waiting for [1m] at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction $AsyncShardOperationAction $4.onTimeout(TransportShardReplicationOperationAction.java:311) at org.elasticsearch.cluster.service.InternalClusterService $1$1.run(InternalClusterService.java:87) at java.util.concurrent.ThreadPoolExecutor $Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor $Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:637) I'm also noticing that while searching multiple indexes at the same time I get very inconsistent results. Trying the same terms comes back with different documents every time. Am I doing something wrong, or does elasticsearch really not support searching multiple indexes simultaneously? It's important to note that I've been working through converting an existing application from using Lucene embedded into an app that can switch back and forth. Most of the code I've written works great when I use Lucene with ParallelMultiReaders, but when switching all that out with the elasticsearch Java API, things go very badly. Are there any hints folks can offer? Are there some things that Lucene programmers should look out for when converting over to the elasticsearch mindset? Thanks, Stephen Starkey. P.S. Here's the code that does the index rebuild (minus the braindead stuff that creates the maps of strings) .. I'm using the Strategy Pattern here so I can use the same algorithm to index data with Lucene and elasticsearch, so there are magic fingers calling the makeRebuildJob method that shoves the Callable into a fixed thread pool of size 10: @Override protected Callable makeRebuildJob(final String absoluteName) { return new Callable() { public Boolean call() throws Exception { newBoard(absoluteName); int cardsIndexed = indexCards(absoluteName, new CardIndexer() { public void indexCard(Card card) throws Exception { client.index(buildIndexRequest(card).create(true)).actionGet(); } }); ``` if (cardsIndexed > 0) { ``` client.admin().indices().optimize(optimizeRequest(absoluteName).maxNumSegments(5).refresh(true). listenerThreaded(false)).actionGet(); } return true; } }; } private static IndexRequest buildIndexRequest(Card card) { return indexRequest(card.getColumn().getBoard().getAbsoluteName()). type("card"). operationThreaded(false). id(String.valueOf(card.getId())). source(IndexUtil.cardToMap(card)); } ---
**Author:** ![Stephen\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephen_2/32/3274_2.png) [@Stephen\_2](https://discuss.elastic.co/u/Stephen_2)\ **Post date:** [July 12, 2010, 12:19am UTC](https://discuss.elastic.co/t/bulk-update-times-out/3085/2 "2010-07-12T00:19:06Z")
One more thing.. here are some log statements showing search inconsistency (using "query":"main" both times): 2010-07-11 19:16:28,986 DEBUG service.ElasticSearchService - [http-8080-3] Query: {"filtered":{"query":{"bool":{"must":{"bool": {"should":{"field":{"col":"pending"}},"should":{"field": {"col":"complete"}},"should":{"field":{"col":"inprocess"}}}},"must": {"query\_string":{"query":"main","fields": ["color","desc","simpleId","title","creator","creatorName","owner","ownerName","taglist","attach"]}}}},"filter": {"bool":{"must\_not":{"range":{"deleted": {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}},"must": {"range":{"appear": {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}}}}}} 2010-07-11 19:16:28,986 DEBUG service.ElasticSearchService - [http-8080-3] Position: 0 2010-07-11 19:16:28,999 DEBUG service.ElasticSearchService - [http-8080-3] Total hits: 2. Collection complete. 2010-07-11 19:16:28,999 DEBUG service.ElasticSearchService - [http-8080-3] Result count: 2 2010-07-11 19:16:31,415 DEBUG service.ElasticSearchService - [http-8080-1] Query: {"filtered":{"query":{"bool":{"must":{"bool": {"should":{"field":{"col":"pending"}},"should":{"field": {"col":"complete"}},"should":{"field":{"col":"inprocess"}}}},"must": {"query\_string":{"query":"main","fields": ["color","desc","simpleId","title","creator","creatorName","owner","ownerName","taglist","attach"]}}}},"filter": {"bool":{"must\_not":{"range":{"deleted": {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}},"must": {"range":{"appear": {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}}}}}} 2010-07-11 19:16:31,416 DEBUG service.ElasticSearchService - [http-8080-1] Position: 0 2010-07-11 19:16:31,431 DEBUG service.ElasticSearchService - [http-8080-1] Total hits: 1. Collection complete. 2010-07-11 19:16:31,432 DEBUG service.ElasticSearchService - [http-8080-1] Result count: 1 ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [July 12, 2010, 5:58pm UTC](https://discuss.elastic.co/t/bulk-update-times-out/3085/3 "2010-07-12T17:58:32Z")
First of all, regarding the exception you get during indexing, is there an exception in the elasticsearch node during that time (or an exception propagated to the index request)? Regarding the inconsistent results. Do you index while you query? It might simply return updated docs that were indexed. Also, its not evident from the code how often you call optimize? -shay.banon On Mon, Jul 12, 2010 at 3:19 AM, Stephen [scstarkey@gmail.com](mailto:scstarkey@gmail.com) wrote: > One more thing.. here are some log statements showing search > inconsistency (using "query":"main" both times): > > 2010-07-11 19:16:28,986 DEBUG service.ElasticSearchService - > [http-8080-3] Query: {"filtered":{"query":{"bool":{"must":{"bool": > {"should":{"field":{"col":"pending"}},"should":{"field": > {"col":"complete"}},"should":{"field":{"col":"inprocess"}}}},"must": > {"query\_string":{"query":"main","fields": > > ["color","desc","simpleId","title","creator","creatorName","owner","ownerName","taglist","attach"]}}}},"filter": > {"bool":{"must\_not":{"range":{"deleted": > > {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}},"must": > {"range":{"appear": > > {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}}}}}} > 2010-07-11 19:16:28,986 DEBUG service.ElasticSearchService - > [http-8080-3] Position: 0 > 2010-07-11 19:16:28,999 DEBUG service.ElasticSearchService - > [http-8080-3] Total hits: 2. Collection complete. > 2010-07-11 19:16:28,999 DEBUG service.ElasticSearchService - > [http-8080-3] Result count: 2 > 2010-07-11 19:16:31,415 DEBUG service.ElasticSearchService - > [http-8080-1] Query: {"filtered":{"query":{"bool":{"must":{"bool": > {"should":{"field":{"col":"pending"}},"should":{"field": > {"col":"complete"}},"should":{"field":{"col":"inprocess"}}}},"must": > {"query\_string":{"query":"main","fields": > > ["color","desc","simpleId","title","creator","creatorName","owner","ownerName","taglist","attach"]}}}},"filter": > {"bool":{"must\_not":{"range":{"deleted": > > {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}},"must": > {"range":{"appear": > > {"from":"19691131","to":"20100611","include\_lower":true,"include\_upper":true}}}}}}} > 2010-07-11 19:16:31,416 DEBUG service.ElasticSearchService - > [http-8080-1] Position: 0 > 2010-07-11 19:16:31,431 DEBUG service.ElasticSearchService - > [http-8080-1] Total hits: 1. Collection complete. > 2010-07-11 19:16:31,432 DEBUG service.ElasticSearchService - > [http-8080-1] Result count: 1 ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:22am UTC](https://discuss.elastic.co/t/bulk-update-times-out/3085/4 "2017-07-06T04:22:26Z")