Kibana version: 7.3
Elasticsearch version: 7.3
APM Server version: 7.3
APM Agent language and version: Self created agent for Delphi 5 and above
I have proposed this question before but the answer I got back didn't solve the issue in its entirety. Here is a link to the original discussion: How to Group Spans, Metadata and Transactions Together for Visualization
At the time we had a work around and the problem wasn't that large but as we developed further, this has only grown in a bigger and bigger issue. Essentially the issue is that there is no legitimate link between Spans, Metadata, Metrics, Transactions, or Errors and therefore APM visualization in Kibana is completely useless.
Lets take this example. I want to know which customer experienced an error in my calculator app. To do this I create a label in each span that is "CustomerName". In my visualization I filter by the CustomerName = Matt's Car Shop. This will give me all the spans that had the customer name Matt's Car Shop. Now I want to get a count of all the errors in each spans associated transaction.
Kibana however has no way of linking the span and the transaction. This means I can't say "how many errors did Matt's Car Shop get". The only way to do this would be to search for all spans with the customer name "Matt's Car Shop", record all the transaction IDs of each span, then filter for exceptions with a particular transaction ID, for every ID I found. This means I can't make appropriate graphs or charts.
The other option would be to add a label to the metadatas context but again, no way to link the metadata back to the transaction and then filter for exceptions by those IDs, in one search.
My use case seems like something everyone would want to be able to know. How many errors did a particular customer receive in a given time period. I would like to be able to create a bar chart that shows each customer and how many errors they received but there is no option to do this.
Can anyone help? Any work arounds that people are aware of? The answer in the original post was that I could create a new index but I don't know what this means.