Kibana logs are not showing in DIscover page

[yasar (Yasar Arafaath A)]

Hi team,

We are injected the logs by manually for few testing and we have done the filebeat, and logstash pipeline and Logstash config file as well as the same.

But after configured and pushed the logs by manually, it could collect the logs in kibana.

Could you please suggest us to proceed further.

Thanks,
Yasar Arafaath A.

[warkolm (Mark Walkom)]

It's not clear what you are asking here sorry, can you elaborate and clarify please.

[yasar (Yasar Arafaath A)]

Hello Mark,

We had received the logs in Filebeat and Logstash side.. But it could not reach the kibana side.. Here are the Filebeat and Logstash Config... Please check once and guide us.

- type: log
  enabled: true
  paths:
    - /tmp/dev.apps/*
  fields_under_root: true
  fields:
        topic_name: -------
        logtype: lcfilterpoc

Logstash Config:

 input {
   kafka {
             bootstrap_servers => ""

             topics             => [""]
             consumer_threads   => 3
             group_id           => "ls-dev-grp"
             security_protocol  => "SSL"
             ssl_truststore_location => "/usr/share/softwares/cert/kafka.client.truststore.jks"
             ssl_truststore_password => "changeit"
            #codec              => "json"
   }
 }


 filter {

        fingerprint {
                source => [ "fingerprint", "log" ]
                target => "[@metadata][fingerprint]"
                method => "SHA1"
                concatenate_sources => true
        }

 }

 output {

  if [logtype] == "lcfilterpoc" {
         elasticsearch {
                index => "ej-lc-%{[logtype]}-%{+YYYY.MM.dd}"
                hosts => [""]
                api_key => [""]
                ssl => true
                ilm_rollover_alias => "ej-lc-lcdroptest"
                ilm_pattern => "000001"
                ilm_policy => "DeleteIndexAfterOneDay"
                document_id => ""
          }
      }
}

Please find the snap from Index Management:

Thanks,
Yasar Arafaath A.