Hello Jeeth,
I figured the issue partially, there is a problem in kafka side
- in the logstash B config side I created a new file with only one topic and started the config file then it was added automatically into logstash consumer group
- I have logstash consumer group in kafka, any topics mentioned as input from kafka they are getting created in Kafka.
- I defined this index solr-slow-requests-log-%{+YYYY.MM.dd} part in new config file( full config) and restarted kafka. This created topic in Kafka but still this is not creating the index so I changed the topic name(like test-topic) and created a new consumer group for the topic(test-topic-group), included the new group_id in logstash config but I kept the index name same. This worked now since it does not belong to logstash index is created and I can see logs in kibana dashboard. But I don't know why if the topic is added into logstash group then I'm not seeing messages pushing into elasticsearch