With default_pipeline, restHighLevelClient's bulkProcessor can't insert records

Elastic Stack Elasticsearch
1

with default_pipeline

PUT _ingest/pipeline/lzm_pipeline
{
  "description" : "lzm pipeline",
  "processors" : [
     {
      "set": {
        "field": "ts",
        "value": "{{_ingest.timestamp}}"
      }
    }
  ]
}

restHighLevelClient's bulkProcessor can't insert records, and throw Exception:

 Unable to parse response body for Response{requestLine=POST /_bulk?timeout=1

restHighLevelClient, elasticsearch are all 7.10.1。

2

From Elastic Agent to Elasticsearch

3

You should upgrade to at least 7.17, better to 8.14 and switch to the new Java client.

Have a look at this blog post which describes a bit how to use the new client and some tips on migrating from the old one.

But anyway, what is the response if you try the same bulk call from the Kibana dev console?

4

Thank you very much!
As your remind, I tried bulk call within kibana dev console, and found the error message:

mapping set to strict, dynamic introduction of [ts] within [_doc] is not allowed

So I modified the index's dynamic to true, and fixed it.

5

Great! But anyway please upgrade your version as this one did not received any of the bug fixes or the security patches for a very long time. Also, so many goodness has been added in 8.x versions...