Filebeat configuration without kibana setup is not working

Elastic Stack Beats
1

Hello,

Currently, I have filebeat version 7.9.1 and trying to use it with Elasticsearch 7.9.1, I don't want to load any dashboards to Kibana as I just want to push the data to specific index of Elastic search, I have used the below configuration but when I run filebeat setup -e it's trying to connect to http://localhost:5601, hence it's failing with Exiting: error connecting to Kibana: fail to get the Kibana version: HTTP GET request to http://localhost:5601/api/status fails: Can you please help me why it's trying to reach to Kibana, all I want is push to data to a specific index of elasticsearch index.

# ============================== Filebeat inputs ===============================

filebeat.inputs:

  - type: log

    enabled: false

    paths:

      - '/usr/share/filebeat/log/*'

# ============================== Filebeat modules ==============================

filebeat.config.modules:

  # Glob pattern for configuration loading

  path: ${path.config}/modules.d/*.yml

  # Set to true to enable config reloading

  reload.enabled: true

# ======================= Elasticsearch template setting =======================

setup.template.enabled: false
setup.dashboards.enabled: false

output.elasticsearch:

  hosts: ['http://localhost:9200']

  username: 'elastic'

  password: 'changeme'

  index: 'testing_index'
2

Welcome to our community! :smiley:

You don't need to run setup if you just want to send the data to Elasticsearch, so does it work if you skip that part?

3

Thanks for your inputs, it's working now with elasticsearch but we are getting some errors while trying to push to elasticsearch

[publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(https://elasticsearch.abc.com)): Connection marked as failed because the onConnect callback failed: 1 error: Error loading pipeline for fileset haproxy/log: couldn't load pipeline: couldn't load json. Error: 403 Forbidden:

But is there any way we can configure filebeat to push to elasticsearch index directly instead of a pipeline, currently we are having some restrictions to use pipeline in our organization as we permission to PUT documents inside specific indices only?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.