I am currently working with my developers to manage log and event ingestion using Azure Event Hub and ELK. Until this morning, my design included data going through the following path:
App -> AEH -> Logstash Cluster -> Elasticsearch
After some research and conversation from my app developer (and prior to my own research being conducted), I'm unsure if I can use a logstash cluster with AEH. It appears that AEH handles the load-balancing of individual logstash instances as long as those are configured to ingest AEH data.
As I'm relatively new to AEH, i'm looking for advice as to whether I should re-architect that side of the logstash ingestion to be individualized nodes instead of a load-balanced cluster. Community advice is welcome.
Thank you
Larry