Thanks for the response. I have tried this but the only issue is elasticsearch cluster is running on on-prem , so i cannot push the logs from file beat running on AWS to on-prem cluster because of the network settings.
are we planning to have the support for filebeat to pull the logs from remote server in the future releases? If yes , i can simply install filebeat on on-prem server and configure that to pull the logs from AWS k8s (as reaching out to public network from on-prem server is possible)
and kindly suggest if there is any better way to overcome this issue?