# BulkAll takes a long time to complete **URL:** \ **Category:** Elasticsearch\ **Created:** [July 10, 2019, 6:47pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848 "2019-07-10T18:47:05Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![CSharpBender](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/csharpbender/32/50377_2.png) [@CSharpBender](https://discuss.elastic.co/u/CSharpBender)\ **Post date:** [July 10, 2019, 6:47pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/1 "2019-07-10T18:47:05Z")
**Elasticsearch version** : 5.6.5 **C# Nest package** : 5.5.0 **JVM version** ( `java -version` ): 9 **OS version** : Windows 10 **Description of the problem including expected versus actual behavior** : Sometimes BulkAll takes a long time to complete. I'm not getting any errors it's just waiting for something, sometimes for 85 seconds or longer. I tested on my local machine with a list containing a single item, so it's not about having too much data or having too many requests. This reproduces when it's called 2-3 times per second. **Steps to reproduce** : ```auto Client.BulkAll(itemArray, i => i.Index() .BackOffTime(TimeSpan.FromSeconds(5)) .BackOffRetries(2) .MaxDegreeOfParallelism(Environment.ProcessorCount) //12 .Size(100) .RefreshOnCompleted()) .Wait(TimeSpan.FromSeconds(60), r => { }); ``` Is there a known problem that was fixed in the newer version of NEST/Elasticsearch? ---
**Author:** ![HenningAndersen](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/henningandersen/32/48188_2.png) [@HenningAndersen](https://discuss.elastic.co/u/HenningAndersen)\ **Post date:** [July 11, 2019, 3:21pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/2 "2019-07-11T15:21:25Z")
Hi @CSharpBender , there are a few options to come closer: 1. Check log files for errors. 2. Enable index slow logs [https://www.elastic.co/guide/en/elasticsearch/reference/5.6/index-modules-slowlog.html](https://www.elastic.co/guide/en/elasticsearch/reference/5.6/index-modules-slowlog.html) 3. This could be garbage collection related, check that GC logs do not have any back to back full GCs. 4. A node crashing or being killed by OS could likely lead to prolonged index time (though I would not expect 85s for a single index request). 5. Network issues between client and ES. 6. I notice you use java 9, could be worth trying with java 8 instead, since 9 is unsupported. 7. Look at hot threads or similar when the issue happens. Before we can guess at whether upgrading will help this, we need to know what caused it. It might be easier to spin up a new ES to see if it reproduces there. ---
**Author:** ![CSharpBender](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/csharpbender/32/50377_2.png) [@CSharpBender](https://discuss.elastic.co/u/CSharpBender)\ **Post date:** [July 11, 2019, 4:00pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/3 "2019-07-11T16:00:47Z")
Hi @HenningAndersen, Thanks for responding, I will check the logs, maybe I find something usefull. Regarding the other points: there is no network involved, it's my local elasticsearch instance and I'm the only one using it. Java is the only hot thread. Regards. ---
**Author:** ![CSharpBender](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/csharpbender/32/50377_2.png) [@CSharpBender](https://discuss.elastic.co/u/CSharpBender)\ **Post date:** [July 17, 2019, 1:34pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/4 "2019-07-17T13:34:07Z")
Hi @HenningAndersen, I enabled slow log but the files are empty. The only issue I could find in the logs is this: > [2019-07-17T00:01:44,242][INFO][o.e.i.IndexingMemoryController] [HostName] now throttling indexing for shard [[IndexName][2]]: segment writing can't keep up After googling I found that it might be related to disk writing (although I have SSD) so I've updated the config to "index.merge.scheduler.max\_thread\_count" : 1. Still, this hasn't fixed my problem, from time to time some threads are freezing and they don't timeout although I've set it to 60seconds. I suspect a NEST 5.5 issue but I might be wrong. LE: After upgrading to NEST v5.6.5 I couldn't reproduce the issue. Can anyone tell me if the version of NEST should be the same as the elasticsearch one? I was using NEST v5.5 and elasticsearch v5.6.5 Thank you ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [July 17, 2019, 4:29pm UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/5 "2019-07-17T16:29:05Z")
Elasticsearch 5.x does not support Java9 as per the [support matrix](https://www.elastic.co/support/matrix#matrix_jvm). ---
**Author:** ![CSharpBender](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/csharpbender/32/50377_2.png) [@CSharpBender](https://discuss.elastic.co/u/CSharpBender)\ **Post date:** [July 18, 2019, 8:09am UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/6 "2019-07-18T08:09:31Z")
Hi @Christian_Dahlqvist, I've uninstalled Java9 and I've installed OpenJava 1.8.0\_212 and the issue continues to reproduce with NEST 5.5 It's not reproducing with NEST 5.6.5, so should the NEST version be the same as the elasticsearch one? ---
**Author:** ![forloop](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/forloop/32/9021_2.png) [@forloop](https://discuss.elastic.co/u/forloop)\ **Post date:** [July 19, 2019, 10:27am UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/7 "2019-07-19T10:27:09Z")
I'd recommend using the latest NEST 5.x version with Elasticsearch 5.x - whilst it may contain new APIs that don't exist in the version of Elasticsearch you're tagreting and hence you won't be able to use them, it'll also contain bug fixes ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 16, 2019, 10:27am UTC](https://discuss.elastic.co/t/bulkall-takes-a-long-time-to-complete/189848/8 "2019-08-16T10:27:20Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.