Bulk index w/ new java-client

divadpoc · March 19, 2022, 8:50pm

Hi, I'm looking for an example of how to do a bulk insert w/ the new java-client (8.1).

Previously (w/ ES 7) I used the high level rest client and a BulkProcessor .

Thanks

dadoonet · March 20, 2022, 10:34am

The BulkProcessor has not been implemented yet in the new client but it will be soon.

Here's some code:

List<BulkOperation> operations = new ArrayList<>();
operations.add(new BulkOperation(IndexOperation.of(b -> b.index("person").id(person.idAsString()).document(person))));
esClient.bulk(br -> br.index("person").operations(operations));

The documentation will be improved in the future.

Here is also a useful class:

github.com

elastic/elasticsearch-java/blob/main/java-client/src/test/java/co/elastic/clients/elasticsearch/end_to_end/RequestTest.java

/*
 * Licensed to Elasticsearch B.V. under one or more contributor
 * license agreements. See the NOTICE file distributed with
 * this work for additional information regarding copyright
 * ownership. Elasticsearch B.V. licenses this file to you under
 * the Apache License, Version 2.0 (the "License"); you may
 * not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package co.elastic.clients.elasticsearch.end_to_end;

This file has been truncated. show original

divadpoc · March 21, 2022, 1:01pm

Thank you for your time. I'll give it a try soon.
So I see it's on the agenda - do you have an estimate timeline?
Thanks again.

dadoonet · March 21, 2022, 2:01pm

I don't. @swallez would probably know if there is a target for this.

swallez · March 21, 2022, 2:28pm

We don't have an exact target but it's very high on the feature priority list. Important to note also that it will be backported to 7.17.

Julian_3 · March 25, 2022, 3:29pm

only post ive found on this, thanks to the guys @elastic for the comments, Im also trying to implement the new java api over the old one with it being deprecated and the docs are non existent. to anyone else i would recommend using the old libs for the time being.

divadpoc · April 19, 2022, 8:51am

I think this is the issue regarding the bulk processor topic - for anyone else stumbling upon this thread in the future

system · May 17, 2022, 8:52am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.