We have Elasticsearch 7.11.1 and Logstash 7.11.2. We have a scenario of indexing data from Logstash to ES. We use a java application that does some data processing and posts data to the Logstash HTTP endpoint. Normally everything works fine and data are indexed in ES as expected. But there are some days when data send to Logstash are not reflected to ES at all.
While checking logs of Elasticsearch and Logstash there is no such error related to not indexing.
Also checked the rejection list in Elasticsearch but all are fine no rejection task was seen.
PS: Every processing writes in its own Logstash, so we also modify the index information on every data processing.
Any suggestion on how can I resolve this issue?