Im new to ELK Stack, and Im trying to increase observability with it. Im here have some doubts that I could not find a answer in other topics, probably because my problem is just too newbie!
I deployed the ELK Stack through elastic.co, and I have all my services hosted at Azure. I got my services embeded with Elastic-Agent reporting metrics and being managed by my deployed Fleet Server. Also, got two services up and running reporting traces to APM.
Now, i was trying to accomplish to also observe my Azure's hosted Postgres Server. Reading I imageine the best flow is
Azure Postgresql > Azure Event Hub > Logstash > Elasticsearch
Is that right, in this flow, I would also be possible to monitor other services hosted there (Azure App Gateway, and others, right?)
But than, the problem is, how do i accomplish this link of Event Hub so it appears the logs/metrics/traces in my Kibana/APM as part of the transactions?
I findout this: GitHub - logstash-plugins/logstash-input-azure_event_hubs: Logstash input for consuming events from Azure Event Hubs
But I dont understand the concept of plugin, should I host a container that will be responsible up and running fetching from Azure Event Hub and sending to Logstash, is that it? And then it might solve my problem?
Can someone give me a tip of the best way to accomplish this? Tried to findout some examples to better understand the concepts but could not.
Thanks in regards,