Filebeat Incompatibility with Opensearch

I have spent almost 4 days on filebeat and opensearch. I have used Filebeat [7.0.0, 8.5.2, 6.0.0] and Opensearch 2.4.0.
But getting the error: "pipeline/output.go:100 Failed to connect to backoff(elasticsearch(http://localhost:9200)): Connection marked as failed because the onConnect callback failed: This Beat requires the default distribution of Elasticsearch. Please upgrade to the default distribution of Elasticsearch from elastic.co, or downgrade to the oss-only distribution of beats"

I read multiple documents on versioning , but with no luck. Just a query, why this versioning has been made so much complex in case of filebeat and Opensearch. And how to fix it?

filebeat.yml:

filebeat.inputs:

  • type: log
    paths:
    • D:\data*

#============================= Filebeat modules ===============================

filebeat.config.modules:
path: ${path.config}/modules.d/*.yml

reload.enabled: true

#==================== Elasticsearch template setting ==========================

setup.template.settings:
index.number_of_shards: 1

setup.kibana:

host: "http://localhost:5601"

output.elasticsearch:
hosts: ["http://localhost:9200"]

#================================ Processors =====================================

processors:

  • add_host_metadata: ~
  • add_cloud_metadata: ~

OpenSearch/OpenDistro are AWS run products and differ from the original Elasticsearch and Kibana products that Elastic builds and maintains. You may need to contact them directly for further assistance.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns :elasticheart: )

Welcome to our community! :smiley:

Use Elasticsearch instead would be the easiest route.

You can find that answer on the opensearch website. They have a dedicted page on what version of filebeat/logstash works.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.