Java BulkProcessor

Atefeh · December 21, 2022, 8:29am

Bulk Java API supported adding a payload to each request in ES version 6.8 :

public BulkProcessor add(DocWriteRequest request, @Nullable Object payload) {
        internalAdd(request, payload);
        return this;
    }

But this feature was removed in version7. Is there an alternative solution for this?
I need to report failed documents.

https://discuss.elastic.co/t/java-bulkprocessor-custom-data-in-request-response-items/105963/4

dadoonet · December 21, 2022, 9:43am

Welcome!

There is a plan to reintroduce it within the new client. See

In the meantime, you could do something very similar by yourself. See

github.com

dadoonet/injector/blob/8e0348378da2483f050ddd4a22a521f19d2e88e5/src/main/java/fr/pilato/elasticsearch/injector/injector/ElasticsearchInjector.java#L111-L118


      
          @Override
          public void inject(int finalI, Person person) {
              bulkOperations.add(IndexOperation.of(c -> c.document(person))._toBulkOperation());
              if (bulkOperations.size() >= bulkSize) {
                  doExecute();
                  bulkOperations = new ArrayList<>(bulkSize);
              }
          }

system · January 18, 2023, 9:43am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.