Elastic Spark ErrorHandler

Elastic Stack Elasticsearch
1

Hello,

Im using elasticsearch-hadoop to index our dataframe via spark sink. I have used the configurations as mentioned in https://www.elastic.co/guide/en/elasticsearch/hadoop/current/errorhandlers.html to configure a custom ErrorHandler. But I fail to get the errorhandler activated when an error occurs.

Doesnt it work when we use or.elasticsearch.spark classes for processing?

2

Hi there,

Do you have an example of the error that the error handler is not handling? It's important to remember that the error handler interfaces are only for handling specific types of exceptions that are reasonable to allow a user to intervene in (usually to do with data serialization and bulk conflicts)

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.