We are developing a application, where we ingest and bulk index time-series data using native JAVA client.
Here each and every document/event is very important to us, we can't miss single event.
As we are using BulkProcessor to index the data, in case of any failures to index data with malformed JSON or bulk queue unavailability or any other reason, is there any way to track the failed documents/events from BulkResponse?
I tried iterating through BulkResponse @ afterBulk() method, but couldn't find actual document/event.
Our plan is to index all such failed documents/events to separate INDEX (like unprocessed), which don't consider any mappings.
Please help me to identify the failed documents