Filebeat configuration without kibana setup is not working

[Mahesh_Gadagi]

Hello,

Currently, I have filebeat version 7.9.1 and trying to use it with Elasticsearch 7.9.1, I don't want to load any dashboards to Kibana as I just want to push the data to specific index of Elastic search, I have used the below configuration but when I run filebeat setup -e it's trying to connect to http://localhost:5601, hence it's failing with Exiting: error connecting to Kibana: fail to get the Kibana version: HTTP GET request to http://localhost:5601/api/status fails: Can you please help me why it's trying to reach to Kibana, all I want is push to data to a specific index of elasticsearch index.

# ============================== Filebeat inputs ===============================

filebeat.inputs:

  - type: log

    enabled: false

    paths:

      - '/usr/share/filebeat/log/*'

# ============================== Filebeat modules ==============================

filebeat.config.modules:

  # Glob pattern for configuration loading

  path: ${path.config}/modules.d/*.yml

  # Set to true to enable config reloading

  reload.enabled: true

# ======================= Elasticsearch template setting =======================

setup.template.enabled: false
setup.dashboards.enabled: false

output.elasticsearch:

  hosts: ['http://localhost:9200']

  username: 'elastic'

  password: 'changeme'

  index: 'testing_index'

[warkolm (Mark Walkom)]

Welcome to our community!

You don't need to run setup if you just want to send the data to Elasticsearch, so does it work if you skip that part?

[Mahesh_Gadagi]

@warkolm

You don't need to run setup if you just want to send the data to Elasticsearch, so does it work if you skip that part?

Thanks for your inputs, it's working now with elasticsearch but we are getting some errors while trying to push to elasticsearch

[publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(https://elasticsearch.abc.com)): Connection marked as failed because the onConnect callback failed: 1 error: Error loading pipeline for fileset haproxy/log: couldn't load pipeline: couldn't load json. Error: 403 Forbidden:

But is there any way we can configure filebeat to push to elasticsearch index directly instead of a pipeline, currently we are having some restrictions to use pipeline in our organization as we permission to PUT documents inside specific indices only?