I'm wet behind the ears on the Elasticsearch product so bear with me.
My goal is to stream data from AWS DynamoDB (via a AWS Kinesis stream) to my hosted Elasticsearch instance. I'm using the functionbeat to do this.
It would seem that everything is working fine for the part where the functionbeat lambda is listening on changes to the stream (so when I make changes to the database I see log churning out in Cloudwatch log for the lambda).
Looking at the log messages it would seem that there are no error so I'm expecting to be able to go the Discover part of the Elasticsearch web console and see some data...but see nada.
I'm not clear on what more I need to do to get data into the Elasticsearch instance.
I've played with some of the processors (namely
decode_json_fields) and they work.
Any pointers appreciated.