Logstash output Elastic App Search plugin

Elastic Stack Logstash
1

Hi,

We have an application which reads emails and store it in Elastic Search using App search Engine where it is working previously with 7.17 Logstash version which is unable to connect to App search with newer versions of Logstash. Our Logstash output configuration is as below,

output {
 	elastic_app_search {
		id	=>	"xxx-prod"
		url	=>	"https://xxx-prod.ent.xxx.aws.found.io"
		path	=> "/api/as/v1/"
		engine	=>	"default"
		api_key	=>	"private-key
		document_id => "%{xxxx}"
    timestamp_destination	=>	"sent_date"
	}

But I have seen that,

  • [BREAKING] Swiftype endpoints are no longer supported for both plugins App Search and Workplace Search. The App Search deprecated options host and path were removed.

since 8.11 version, path option is removed for which I am getting error when I tried to use the configuration with recent Logstash versions and also it is not working if I remove path.

url => "https://xxx-prod.ent.xxx.aws.found.io"

I tried adding /api/v1/engines or /api/v1/ also didn't work where it gave 401 & 404 errors.

][ERROR][logstash.javapipeline ][xxx] Pipeline error {:pipeline_id=>"xxx", :exception=>#<LogStash::ConfigurationError: Failed to connect to App Search. Please check your credentials. Error: [401] {"error":"You need to sign in before continuing."}>

Link for Reference:

Is anyone familiar with this issue?