Use of beats, logstash, kibana somewhat of distaster

Elastic Stack Beats
1

Helloi Elasticsearch

The beats and logstash documentation is by no stretch of the imagination clear.

  1. From by app server I can write json logs to logstash and then I can see the records in kibana. Great, but worthless because I cant visualize in kibana.

This is what I see in a record in kibana of a json field

indexed fields cant be searched.

Here is my logstash config:

input {
        beats {
        port => "5043"
        ssl => false
        codec => "json"
    }

   key => "logstash"
}


output {
        elasticsearch {
hosts => ["127.0.0.1:9200"]

}
    stdout {}
}

Here is my beats config:

filebeat:
  prospectors:
    -
      paths:
        - "/tmp/upload.log"
        - "/var/log/nginx/access.log"
        - "/var/log/nginx/error.log"
      fields:
        type: log
      exclude_lines: ["^.*ELB-HealthChecker.*$"]
output:
  logstash:
    hosts: ["127.0.0.1:5043"]

So why? I do have valid json.

2

This SO post solved my issue

3

This topic was automatically closed after 21 days. New replies are no longer allowed.