We are getting two different offset values for same message

We have two logstash pods which are reading the data from elasticsearch from one index for last 24 hr data and then sending data to Kafka server.
We can see two different offset are created for similar log message.
Is there any way to avoid the duplication from kafka?

Could someone please help us in resolving the issue?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.