I am using kafka connect elasticsearch sink to index data from kafka to elasticsearch index. The problem which I am facing is for particular event a field value is coming as text and for some event it's coming as object. The events for which it's coming as object, documents are being error-ed out. I tried using ignore malformed but it doesn't work for text field I tried though. Any other way by which we can at-least index those documents rather than loosing them.
Your best option is to solve it in kafka and force the type.
What did you do? What didn't work?