# Nest BulkAll - Error: 'BulkAll halted after receiving failures that can not be retried from \_bulk' **URL:** \ **Category:** Elasticsearch\ **Tags:** language-clients, ingest-pipeline\ **Created:** [May 17, 2022, 1:50pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949 "2022-05-17T13:50:18Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![dumstattd](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dumstattd/32/105799_2.png) [@dumstattd](https://discuss.elastic.co/u/dumstattd)\ **Post date:** [May 17, 2022, 1:50pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/1 "2022-05-17T13:50:18Z")
I am currently using a foreach to index through a pipeline using the nest client. This is slow and highly inefficient. But works. For that same dataset, I tried using the BulkAll command as follows to push the same data through the same pipeline during indexing. However, this results in errors. Error: "BulkAll halted after receiving failures that can not be retried from \_bulk" Looking at the reason it says its a 201 status code which to me means created. And I see data showing up in the index as well. Here is the code I am using to push the data into the index through the pipeline. ```auto public void IngestViaPipeline(IEnumerable data, string indexName, string pipelineName) where T : class { var pageSize = 1; var bulkAllObservable = _client.BulkAll(data, b => b .Index(indexName) .Pipeline(pipelineName) .BackOffRetries(10) .BackOffTime("30s") .RefreshOnCompleted() .MaxDegreeOfParallelism(Environment.ProcessorCount) .Size(pageSize) .RetryDocumentPredicate((item, doc) => { return true; }) .DroppedDocumentCallback((item, doc) => { _logger.LogError($"Could not index doc.{Environment.NewLine}{item}{Environment.NewLine}{System.Text.Json.JsonSerializer.Serialize(doc)}"); }) ); var waitHandle = new ManualResetEvent(false); ExceptionDispatchInfo exceptionDispatchInfo = null; var observer = new BulkAllObserver( onNext: response => { _logger.LogDebug($"Bulk Indexing Page: {response.Page} out of {data.Count() / pageSize} for Index: {indexName} using Pipeline: {pipelineName}"); }, onError: exception => { exceptionDispatchInfo = ExceptionDispatchInfo.Capture(exception); waitHandle.Set(); }, onCompleted: () => waitHandle.Set() ); bulkAllObservable.Subscribe(observer); waitHandle.WaitOne(); exceptionDispatchInfo?.Throw(); } ``` I have looked at the code long enough and tried about everything I can find in the docs about this command. So I am sure it is fatigue letting me miss the critical thing. What can I do differently to pinpoint the cause? Is there anything I am doing incorrectly here? ---
**Author:** ![stevejgordon](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stevejgordon/32/80912_2.png) [@stevejgordon](https://discuss.elastic.co/u/stevejgordon)\ **Post date:** [May 17, 2022, 2:03pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/2 "2022-05-17T14:03:10Z")
Hi @dumstattd. I think you're missing `.ContinueAfterDroppedDocuments()` in your BulkAll configuration which enable the continuation after any failed documents. Those failures should then invoke the callback. ---
**Author:** ![dumstattd](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dumstattd/32/105799_2.png) [@dumstattd](https://discuss.elastic.co/u/dumstattd)\ **Post date:** [May 17, 2022, 7:33pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/3 "2022-05-17T19:33:20Z")
Hello @stevejgordon That did not seem to do the trick. After that I did not get anymore errors reported than before. Error shown: ```auto MyService[0] Elasticsearch.Net.ElasticsearchClientException: Bulk indexing failed and after retrying 10 times at Nest.BulkAllObservable`1.BulkAsync(IList`1 buffer, Int64 page, Int32 backOffRetries) at Nest.BulkAllObservable`1.RetryDocuments(Int64 page, Int32 backOffRetries, IList`1 retryDocuments) ``` I did add in more logging within RetryDocumentPredicate in order to show the item and the doc value. The Item is as such. ```auto Retrying to index doc. index returned 200 _index: myindex _type: _id: 1 _version: 14 error: ``` The data itself I can send using IndexManyAsync and it does not have a problem with it. But when sending through BulkAll it seems to not accept the document. ---
**Author:** ![dumstattd](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dumstattd/32/105799_2.png) [@dumstattd](https://discuss.elastic.co/u/dumstattd)\ **Post date:** [May 17, 2022, 8:33pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/4 "2022-05-17T20:33:38Z")
Does the json serializer change between bulk and IndexManyAsync? I can take that exact document and post it to the index using the pipeline through VSCode Elastic Client and it will only work when using camel case. Does bulk not send via camel case? ---
**Author:** ![dumstattd](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dumstattd/32/105799_2.png) [@dumstattd](https://discuss.elastic.co/u/dumstattd)\ **Post date:** [May 18, 2022, 3:45pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/5 "2022-05-18T15:45:40Z")
I just flipped it to use Index instead of bulkall. With a foreach wrapping it and it works just fine using the same exact data. So then I flipped over to using Bulk instead of BulkAll and put in my own paging method to page through 1000 record chunks. Again works flawlessly. So too me it starts to either point to a bug in BulkAll or that the documentation is incorrect/incomplete. > **[Indexing documents | Elasticsearch .NET Client \[8.2\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/client/net-api/current/indexing-documents.html#_advanced_bulk_indexing)** ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [June 15, 2022, 3:45pm UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/6 "2022-06-15T15:45:46Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed. ---
**Author:** ![Martijn\_Laarman](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/martijn_laarman/32/4410_2.png) [@Martijn\_Laarman](https://discuss.elastic.co/u/Martijn_Laarman)\ **Post date:** [August 23, 2022, 9:47am UTC](https://discuss.elastic.co/t/nest-bulkall-error-bulkall-halted-after-receiving-failures-that-can-not-be-retried-from-bulk/304949/7 "2022-08-23T09:47:45Z")
@dumstattd I think this is indeed a bug and I think I've found the cause. Created the following issue to explain and track the failure. > > > BulkAll has an option to continue after dropped documents: https://github.com/el…astic/elasticsearch-net/blob/b7dd9cf58c67cccc6d7f679b5883a155e112f5e2/src/Elastic.Clients.Elasticsearch/Helpers/IBulkAllRequest.cs#L17 > > HandleDroppedDocuments takes this setting into account and only throws an exception if we are not continueing after seeing dropped documents https://github.com/elastic/elasticsearch-net/blob/584edb8b4e8a9ec47bbb53d4f3c1a3a4c80db8f1/src/Elastic.Clients.Elasticsearch/Helpers/BulkAllObservable.cs#L173 > > However later after retrying we through if we still hold retryableDocuments. This should also check this configuration setting and treat them as dropped documents: > > However later we don't classify retried to completion bulk items as dropped and do not make this check conditional: https://github.com/elastic/elasticsearch-net/blob/584edb8b4e8a9ec47bbb53d4f3c1a3a4c80db8f1/src/Elastic.Clients.Elasticsearch/Helpers/BulkAllObservable.cs#L178