Read S3 data and index using Elastic Agent

Elastic Stack Elastic Agent
1

Hi,

Currently, I am pushing the lambda logs to the S3 bucket using the AWS firehose extension and it was working fine and logs are available in the S3 bucket.

  • id: aws-s3-aws.s3access
    type: aws-s3
    data_stream:
    dataset: aws.s3access
    type: logs
    queue_url: null
    max_number_of_messages: 5
    tags:
    • forwarded
    • aws-s3access
      publisher_pipeline.disable_host: true

I am using the elastic standalone agent and I gave the below inputs but it is not reading. How to set up the index configuration? I need to read the s3 object and parse that and write to the index.