Dear All,
I need a observability solution for a mid size enterprise for distributed tracing.
I have a pipeline to ingest logs i.e. service -> kafka -> process by pyspark -> ES
I do not want to use elastic agent(because we use C++) instead create custom logs by individual services to match elastic schema and feed to ES. Can I use elastic apm seamlessly by using above method. Can I do tracing visualisation of spans etc? Would this be a good idea. The solution needs to be scalable. Please suggest if this can be done any other way.
Thank you