Filebeat Incompatibility with Opensearch

[Anish_Mittal]

I have spent almost 4 days on filebeat and opensearch. I have used Filebeat [7.0.0, 8.5.2, 6.0.0] and Opensearch 2.4.0.
But getting the error: "pipeline/output.go:100 Failed to connect to backoff(elasticsearch(http://localhost:9200)): Connection marked as failed because the onConnect callback failed: This Beat requires the default distribution of Elasticsearch. Please upgrade to the default distribution of Elasticsearch from elastic.co, or downgrade to the oss-only distribution of beats"

I read multiple documents on versioning , but with no luck. Just a query, why this versioning has been made so much complex in case of filebeat and Opensearch. And how to fix it?

filebeat.yml:

filebeat.inputs:

• type: log
  paths:
  • D:\data*

#============================= Filebeat modules ===============================

filebeat.config.modules:
path: ${path.config}/modules.d/*.yml

reload.enabled: true

#==================== Elasticsearch template setting ==========================

setup.template.settings:
index.number_of_shards: 1

setup.kibana:

host: "http://localhost:5601"

output.elasticsearch:
hosts: ["http://localhost:9200"]

#================================ Processors =====================================

processors:

• add_host_metadata: ~
• add_cloud_metadata: ~

[system]

OpenSearch/OpenDistro are AWS run products and differ from the original Elasticsearch and Kibana products that Elastic builds and maintains. You may need to contact them directly for further assistance.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns )

[warkolm (Mark Walkom)]

Welcome to our community!

@Anish_Mittal

And how to fix it?

Use Elasticsearch instead would be the easiest route.

[RudyStolds (not relevant)]

You can find that answer on the opensearch website. They have a dedicted page on what version of filebeat/logstash works.