# Best way to visualize health and structure of data processing pipeline

**URL:** <https://discuss.elastic.co/t/best-way-to-visualize-health-and-structure-of-data-processing-pipeline/250458>\
**Category:** Kibana\
**Created:** [September 30, 2020, 7:23am UTC](https://discuss.elastic.co/t/best-way-to-visualize-health-and-structure-of-data-processing-pipeline/250458 "2020-09-30T07:23:02Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![Wolfram\_Haussig](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wolfram_haussig/32/70528_2.png) [@Wolfram\_Haussig](https://discuss.elastic.co/u/Wolfram_Haussig)\
**Post date:** [October 5, 2020, 4:53am UTC](https://discuss.elastic.co/t/best-way-to-visualize-health-and-structure-of-data-processing-pipeline/250458/6 "2020-10-05T04:53:00Z")

</div>

Hello Florian,

Unfortunately, I do not have experiences with Spark nor with with Scala.

Form what I have read is that Scala is compiled to Java Bytecode so the Java agent might work - even if you might have to manually instrument the code if the used libraries are not yet supported(see [here](https://discuss.elastic.co/t/apm-agent-in-scala-application/138850/2)).

I do not know Spark but distributed environments are the place where APM shines as it shows the relations in a service map, shows calls to other services in the same Trace and so on. On each application installation you can configure the service name and the environment so you could have X installations of the same installation shown in the same entry in APM for Y different environments like DEV/QA/PROD. I cannot say how this shows in the Service Maps as we have no Platinum license which is required for the service maps.

Best regards  
Wolfram

---

_[View the full topic](https://discuss.elastic.co/t/best-way-to-visualize-health-and-structure-of-data-processing-pipeline/250458)._