Hi
Am using filebeat 6.5.1 connected to ES 6.5 , was trying/googling to find a fix to index creation problem. metricbeat and heartbeat installed in same machine are working fine (creating index and all)
ALL my ES/Kibana and beats are in same machine so configuration are pretty simple . Tried many steps given in similar issues and didn't succeeded any help would be much useful
**File beat log**
2018-12-13T16:56:16.043Z DEBUG [elasticsearch] elasticsearch/client.go:711 Ping status code: 200
2018-12-13T16:56:16.043Z INFO elasticsearch/client.go:712 Connected to Elasticsearch version 6.5.1
2018-12-13T16:56:16.043Z DEBUG [elasticsearch] elasticsearch/client.go:730 HEAD http://localhost:9200/_template/filebeat
2018-12-13T16:56:16.047Z INFO template/load.go:129 Template already exists and will not be overwritten.
2018-12-13T16:56:16.047Z DEBUG [modules] fileset/pipelines.go:45 Required processors:
2018-12-13T16:56:16.047Z DEBUG [elasticsearch] elasticsearch/client.go:730 GET http://localhost:9200/_ingest/pipeline/filebeat-6.5.1-logstash-log-pipeline-plain
2018-12-13T16:56:16.048Z DEBUG [modules] fileset/pipelines.go:71 Pipeline filebeat-6.5.1-logstash-log-pipeline-plain already loaded
2018-12-13T16:56:16.048Z DEBUG [modules] fileset/pipelines.go:45 Required processors:
2018-12-13T16:56:16.048Z DEBUG [elasticsearch] elasticsearch/client.go:730 GET http://localhost:9200/_ingest/pipeline/filebeat-6.5.1-logstash-slowlog-pipeline-plain
2018-12-13T16:56:16.049Z DEBUG [modules] fileset/pipelines.go:71 Pipeline filebeat-6.5.1-logstash-slowlog-pipeline-plain already loaded
2018-12-13T16:56:16.049Z DEBUG [modules] fileset/pipelines.go:45 Required processors:
2018-12-13T16:56:16.049Z DEBUG [fileset] fileset/fileset.go:220 Comparing ES version 6.5.1 with requirement of 6.1.0
2018-12-13T16:56:16.049Z DEBUG [elasticsearch] elasticsearch/client.go:730 GET http://localhost:9200/_ingest/pipeline/filebeat-6.5.1-system-syslog-pipeline
2018-12-13T16:56:16.050Z DEBUG [modules] fileset/pipelines.go:71 Pipeline filebeat-6.5.1-system-syslog-pipeline already loaded
2018-12-13T16:56:16.050Z DEBUG [modules] fileset/pipelines.go:45 Required processors:
2018-12-13T16:56:16.050Z DEBUG [fileset] fileset/fileset.go:220 Comparing ES version 6.5.1 with requirement of 6.1.0
Filebeat YML
filebeat.inputs:
# Each - is an input. Most options can be set at the input level, so
# you can use different inputs for various configurations.
# Below are the input specific configurations.
- type: log
# Change to true to enable this input configuration.
enabled: true
# Paths that should be crawled and fetched. Glob based paths.
paths:
#- /var/log/*.log
- /data/logs/grafana/*.log
- /data/logs/metricbeat/*
#- c:\programdata\elasticsearch\logs\*
#==================== Elasticsearch template setting ==========================
setup.template.name: "filebeat"
setup.template.pattern: "filebeat-*"
setup.template.overwrite: false
setup.template.settings:
index.number_of_shards: 1
#index.codec: best_compression
#_source.enabled: false
#-------------------------- Elasticsearch output ------------------------------
output.elasticsearch:
# Array of hosts to connect to.
hosts: ["localhost:9200"]
index: "filebeat-%{[beat.version]}-%{+yyyy.MM.dd}"
filebeat.registry_file: /var/lib/filebeat/registry
# Optional protocol and basic auth credentials.
#protocol: "https"
#username: "elastic"
#password: "changeme"