Indexing documents with different data types for a same field

I am using kafka connect elasticsearch sink to index data from kafka to elasticsearch index. The problem which I am facing is for particular event a field value is coming as text and for some event it's coming as object. The events for which it's coming as object, documents are being error-ed out. I tried using ignore malformed but it doesn't work for text field I tried though. Any other way by which we can at-least index those documents rather than loosing them.

Your best option is to solve it in kafka and force the type.

What did you do? What didn't work?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.