Thank you... I think I am getting there.. Here is the new screenshot. Elasticsearch not having the logstash feed.
Here is the elastic feed:
curl -XGET 127.0.0.1:9200/_cat/indices?v
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
yellow open ratings L7klfQ_0S4ezn8iWPiSCTA 5 1 100004 0 12.4mb 12.4mb
yellow open movies qkHy6aPDQESEPQEygQCD7Q 5 1 9125 0 1.3mb 1.3mb
yellow open tags RVWyQcYCQHq-HbADA0PRjg 5 1 1296 0 300.8kb 300.8kb
Here is the logstash script run:
/usr/share/logstash/bin$ sudo ./logstash --path.settings /etc/logstash -f /etc/logstash/conf.d/logstash.conf
Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties
[2018-09-05T10:16:11,704][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2018-09-05T10:16:13,483][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"6.4.0"}
[2018-09-05T10:16:21,802][INFO ][logstash.pipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50}
[2018-09-05T10:16:23,043][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://localhost:9200/]}}
[2018-09-05T10:16:23,064][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://localhost:9200/, :path=>"/"}
[2018-09-05T10:16:23,750][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://localhost:9200/"}
[2018-09-05T10:16:23,894][INFO ][logstash.outputs.elasticsearch] ES Output version determined {:es_version=>6}
[2018-09-05T10:16:23,909][WARN ][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the type
event field won't be used to determine the document _type {:es_version=>6}
[2018-09-05T10:16:23,985][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//localhost:9200"]}
[2018-09-05T10:16:24,044][INFO ][logstash.outputs.elasticsearch] Using mapping template from {:path=>nil}
[2018-09-05T10:16:24,093][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"template"=>"logstash-", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s"}, "mappings"=>{"default"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}}
[2018-09-05T10:16:25,218][INFO ][logstash.inputs.file ] No sincedb_path set, generating one based on the "path" setting {:sincedb_path=>"/var/lib/logstash/plugins/inputs/file/.sincedb_a41128b87621637bbba893f760026e5e", :path=>["/home/sidraj/access_log*"]}
[2018-09-05T10:16:25,296][INFO ][logstash.pipeline ] Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0xc159253 run>"}
[2018-09-05T10:16:25,457][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2018-09-05T10:16:25,526][INFO ][filewatch.observingtail ] START, creating Discoverer, Watch with file and sincedb collections
[2018-09-05T10:16:26,456][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}