Java BulkProcessor

Atefeh · December 21, 2022, 8:29am

Bulk Java API supported adding a payload to each request in ES version 6.8 :

public BulkProcessor add(DocWriteRequest request, @Nullable Object payload) {
        internalAdd(request, payload);
        return this;
    }

But this feature was removed in version7. Is there an alternative solution for this?
I need to report failed documents.

https://discuss.elastic.co/t/java-bulkprocessor-custom-data-in-request-response-items/105963/4

dadoonet · December 21, 2022, 9:43am

Welcome!

There is a plan to reintroduce it within the new client. See

In the meantime, you could do something very similar by yourself. See

github.com

dadoonet/injector/blob/8e0348378da2483f050ddd4a22a521f19d2e88e5/src/main/java/fr/pilato/elasticsearch/injector/injector/ElasticsearchInjector.java#L111-L118


      
          @Override
          public void inject(int finalI, Person person) {
              bulkOperations.add(IndexOperation.of(c -> c.document(person))._toBulkOperation());
              if (bulkOperations.size() >= bulkSize) {
                  doExecute();
                  bulkOperations = new ArrayList<>(bulkSize);
              }
          }

system · January 18, 2023, 9:43am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
How to use BulkProcessor in Version 8.x.x? Elasticsearch	3	1220	August 25, 2022
New elasticsearch java API BulkProcessor Elasticsearch language-clients	4	302	August 22, 2022
Bulk Processor api not working Elasticsearch	4	3296	January 10, 2017
Does the new elasticsearch Java API client BulkOperation, BulkRequest, BulkResponse works similarly with HLRC BulkProcessor? Elasticsearch language-clients	3	376	August 19, 2022
Compress elasticsearch bulkrequest using java high level rest client and bulk processor Elasticsearch language-clients	8	2787	September 3, 2021

Java BulkProcessor

Related Topics