# Kibana APM not showing @CaptureSpan and @CaptureTransaction **URL:** \ **Category:** APM\ **Created:** [March 19, 2019, 5:02pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026 "2019-03-19T17:02:39Z")\ **Posts on this page:** 20\ **Page:** 2
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [March 28, 2019, 11:34am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/21 "2019-03-28T11:34:28Z")
Hi again, Since I feel it is necessary in any case, I did a PR to log the location of the classes that agent causes loading and with the ability to disable the checks we do that may raise this problem. You can download [this snapshot jar](https://apm-ci.elastic.co/job/apm-agent-java/job/apm-agent-java-mbp/job/PR-548/1/artifact/src/github.com/elastic/apm-agent-java/elastic-apm-agent/target/elastic-apm-agent-1.5.1-SNAPSHOT.jar) and test it. With this snapshot, if you set the agent log level to `DEBUG` it should print out where it found the `javax/ws/rs/Path` class. In addition, by adding `-Delastic.apm.enable_class_loading_pre_filtering=false` to the agent config you would disable the code that I suspect is related to it and see if this solves the problem. The effect would be longer startup time, but not necessarily very considerable, depending on your app. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [March 28, 2019, 3:38pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/22 "2019-03-28T15:38:51Z")
Hi Eyal, I downloaded **elastic-apm-agent-1.5.1-SNAPSHOT.jar** My JAVA\_OPTS in catalina.sh are now: `JAVA_OPTS="-DTOMCAT1 -verbosegc -Xms64M -Xmx8G -XX:MaxPermSize=1024M -noverify -DQES_DIR=$SOFTWARE/conf -Dfile.encoding=UTF-8 -Dlog4j.configuration=file://$SOFTWARE/conf/log4j.properties -Dorg.owasp.esapi.resources=$SOFTWARE/conf -javaagent:/usr/software/apm-client/elastic-apm-agent-1.5.1-SNAPSHOT.jar -Delastic.apm.service_name=qeswebmonitor -Delastic.apm.server_url=http://localhost:8200 -Delastic.apm.application_packages=com.qwam -Delastic.apm.log_level=DEBUG -Delastic.apm.enable_class_loading_pre_filtering=false "` If I remove **jersey-core-1.9.jar** from **mypapp/webapp/WEB-INF/lib** my app refuses to deploy with a NoClassDefFound with or without your new filter: [Logs: Without jersey without filter](http://demo.qwamci.com/qesdemo/pdftemp/without_jersey_jar_filtering_false.txt) [Logs without jersey, with filter](http://demo.qwamci.com/qesdemo/pdftemp/without_jersey_jar.txt) With **jersey-core-1.9.jar** and your filter disabled , the app deploys ... [Logs: With jersey and your filter disabled](http://demo.qwamci.com/qesdemo/pdftemp/with_jersey_jar_filtering_false.txt) ... we are back to the former situation we had but with no more explanations about which jar it is conflicting with. Besides, I do not care much about that, since it works now. Still no trace of my Spans and Transactions annotations in Kibana. ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [March 31, 2019, 10:03am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/23 "2019-03-31T10:03:54Z")
> [@ivanqwam](#): > > If I remove **jersey-core-1.9.jar** from **mypapp/webapp/WEB-INF/lib** my app refuses to deploy with a NoClassDefFound with or without your new filter: Then maybe there are no conflicting jars, and this comes from something in the way `WebappClassLoaderBase` is looking for already loaded classes that prevents it from finding a defined class even if it uses the same jar. In any case, this last configuration only means a bit longer startup time, but same functionality is expected so it should be good enough. > Still no trace of my Spans and Transactions annotations in Kibana. Right, that's what we wanted to reproduce in a clean environment, and this is done. What [I saw in prior logs](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/4) was that the `xmlToFacets` appeared in the stack trace of a traced transaction. Would you please run again the same configuration only with `TRACE` logging level instead of `DEBUG` so that we can the log with stack traces on the clean env? ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 1, 2019, 8:29am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/24 "2019-04-01T08:29:40Z")
Hi Eyal, I have a difficult thing to say: I did not notice but the source file I put the annotation in, is in **groovy** 🥵 I did not notice the extension of the file, and nothing looks more like a Java source file than a groovy source file. This projects uses more and more Groovy since our developers favours it. I guess that groovy is not supported yet. I apologize for this Eyal since I should have told you this first thing , but I missed it. This explains that everything works due to the java compatible code generated but a tiny thing must me missing somewhere in the instrumentation, due to the groovy compilation, preventing the annotations to work properly. I do not know if you still want to talk to me. Here are the [logs](http://demo.qwamci.com/qesdemo/pdftemp/back_to_trace_mode.log) with TRACE enabled as you requested it ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [April 1, 2019, 8:57am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/25 "2019-04-01T08:57:54Z")
Ivan, No worries, I am glad we have a reasonable explanation, and you found an issue I fixed anyway, which is great 😃 . Do you compile the groovy to Java bytecode? If so, maybe all you need is make sure that the **API jar** is included in the compile classpath, like explained in [this groovyc documentation](http://groovy-lang.org/groovyc.html)? Regards, Eyal. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 1, 2019, 10:44am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/26 "2019-04-01T10:44:37Z")
Sorry Eyal, but I do not get what you mean. On my desktop, where we are running thoses tests, I am using the IDE Intellij from Idea with the basic groovyc compiler. This compiler generates stubs, which are the source classes translated from groovy to Java and then compiles it with javac (as far as I understand it). There is not much that I can do to interfere in the process. ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [April 1, 2019, 11:07am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/27 "2019-04-01T11:07:01Z")
Ivan, I believe there is a place to configure the `groovyc` compile classpath in the IDE, but I won't be able to assist with locating that. If you find a way for the annotations to make their way to the compiled Java bytecode, you should be able to get your methods traced. Let me know if there's anything else I can do. Regards, Eyal. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 1, 2019, 12:12pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/28 "2019-04-01T12:12:33Z")
Generally annotations make their way through, since we have other Spring annotations which make their way through, both in Groovy and Java. I took enough of your time and thank you again for your kind and extensive support Eyal. I will wait for the moment when APM fully support groovy, APM is already helping us much as is. Please close the case. ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [April 1, 2019, 12:18pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/29 "2019-04-01T12:18:22Z")
This is not a problem at all. I assume this is only a matter of definition- either in the project dependencies or for the `groovyc`, but I will leave this to you 🙂. I am very glad that you find our solution useful! All the best, Eyal. ---
**Author:** ![fredgalvao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fredgalvao/32/42048_2.png) [@fredgalvao](https://discuss.elastic.co/u/fredgalvao)\ **Post date:** [April 2, 2019, 7:16pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/30 "2019-04-02T19:16:48Z")
I found a few weeks ago that the AOP filters for ByteBuddy are ignoring everything that comes from a groovy classloader, so it's not a matter of simply making sure the api jar is in the classpath. Source: [https://github.com/elastic/apm-agent-java/blob/aaccd273c241a4b22da6d4bdb3e09cf5ed8bf37b/apm-agent-core/src/main/java/co/elastic/apm/agent/bci/ElasticApmAgent.java#L308](https://github.com/elastic/apm-agent-java/blob/aaccd273c241a4b22da6d4bdb3e09cf5ed8bf37b/apm-agent-core/src/main/java/co/elastic/apm/agent/bci/ElasticApmAgent.java#L308) I've had to create my own aspect to mimic `@CaptureSpan` and `@CaptureTransaction` for our projects, and it's limited because it only works on spring beans. To make it global, I'd have to link another javaagent via VMOptions, which is bad considering I already have the apm java agent on. I'd love to see the `apm-agent-java` gain official support for groovy, even if it's only by making sure it tries to work the annotations in a groovy classloader. I'd be willing to test a snapshot, considering I already have some projects up for it on the process of going through full observability. ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [April 3, 2019, 8:54am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/31 "2019-04-03T08:54:08Z")
@fredgalvao Thanks for the feedback! Are you referring to groovy precompiled to bytecode, or interpreted at runtime? If the latter- yeah, I assume this would require specific support. If the former- can you provide a compiled class, or check yourself if the annotations get there at all? In either case, did you consider using [our explicit APIs](https://www.elastic.co/guide/en/apm/agent/java/current/public-api.html#api-start-transaction), instead of annotations? You can achieve the same things (and more) with those. Lastly, if you DO eventually develop something useful and want to share with the community- talk to us. We will love to assist with contributions. Currently, formal support for groovy is not on the immediate roadmap not because we don't think it is important, but because of other stuff prioritized higher. Cheers, Eyal. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 4, 2019, 7:39am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/32 "2019-04-04T07:39:35Z")
Hi Eyal, In our configuration we are in fully compiled groovy with @TypeCheck annotation enabled Following your suggestion to use the explicit API, I shifted from the annotation to the explicit API by adding this at the beginning .... ``` Transaction transaction = ElasticApm.startTransaction(); transaction.setName("ResultatService#retrieveAll()"); transaction.setType(Transaction.TYPE_REQUEST); ``` ... and this at the end of our method ``` transaction.end() ``` .. but "ResultatService#retrieveAll()" do not show up in Kibana. ---
**Author:** ![felixbarny](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/felixbarny/32/27341_2.png) [@felixbarny](https://discuss.elastic.co/u/felixbarny)\ **Post date:** [April 4, 2019, 8:26am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/33 "2019-04-04T08:26:38Z")
If `ResultatService#retrieveAll()` is already part of an existing transaction, use `ElasticApm.currentSpan().startSpan()`, instead of creating another transaction. Otherwise, could you upload the full debug logs of the agent, including the whole startup, up until the first invocation where `ResultatService#retrieveAll()` is supposed to be part of? Also wait until the reporter is flushed (10s) so that the logs contain the APM Server response. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 4, 2019, 9:30am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/34 "2019-04-04T09:30:54Z")
I apologize for the API misuse. I shifted my code to ... ``` Span span = ElasticApm.currentSpan().startSpan() span.setName("ResultatService#retrieveAll()") span.end() ``` ... and **It works !!!!!!** 🤩 I can now clearly see my spans in Kibana which leverages the great power of APM giving us insights of our app performance that we never had before. So for compiled Groovy with @TypeCheck enabled, I validate that the explicit API works ! Thank you Felix and Eyal for your great help ---
**Author:** ![fredgalvao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fredgalvao/32/42048_2.png) [@fredgalvao](https://discuss.elastic.co/u/fredgalvao)\ **Post date:** [April 8, 2019, 11:10pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/35 "2019-04-08T23:10:12Z")
To begin with, what I had initially done was create my own marker annotations with partial support for AOP (that would only work on spring beans, and it wasn't even 100% of all cases), so that I could use it on our groovy codebase (edit: to use the explicit API around code with ease). Now, I may have very good news. Please see, vote, comment, test, and support this: [https://github.com/elastic/apm-agent-java/pull/567](https://github.com/elastic/apm-agent-java/pull/567) ---
**Author:** ![fredgalvao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fredgalvao/32/42048_2.png) [@fredgalvao](https://discuss.elastic.co/u/fredgalvao)\ **Post date:** [April 11, 2019, 7:50pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/36 "2019-04-11T19:50:54Z")
@ivanqwam, Now that [the PR was merged](https://github.com/elastic/apm-agent-java/pull/567), you should test it with a snapshot version and see if it works for you on that groovy code, so that you don't have to use the explicit API. Also, @Eyal_Koren is there any plan to do a release with that soon? ---
**Author:** ![felixbarny](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/felixbarny/32/27341_2.png) [@felixbarny](https://discuss.elastic.co/u/felixbarny)\ **Post date:** [April 12, 2019, 7:09am UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/37 "2019-04-12T07:09:28Z")
Yes, we’ll release soon. Make sure to subscribe for releases on GitHub. ---
**Author:** ![ivanqwam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ivanqwam/32/28102_2.png) [@ivanqwam](https://discuss.elastic.co/u/ivanqwam)\ **Post date:** [April 15, 2019, 12:03pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/38 "2019-04-15T12:03:54Z")
All, I downloaded **elastic-apm-agent-1.5.1-20190415.093919-19.jar** I replaced explicit calls by **@CaptureSpan** and .... **it works now !** Spans are now showing in Kibana APM dashboard We are using groovy-2.4.14 Congrats Frederico ! ---
**Author:** ![Eyal\_Koren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eyal_koren/32/36830_2.png) [@Eyal\_Koren](https://discuss.elastic.co/u/Eyal_Koren)\ **Post date:** [April 15, 2019, 12:31pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/39 "2019-04-15T12:31:34Z")
@ivanqwam @fredgalvao Thanks a lot for your efforts and wonderful contribution! :elasticheart: Version 1.6.0 will be out today or tomorrow and should contain the fix "officially" 🎉 ---
**Author:** ![fredgalvao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fredgalvao/32/42048_2.png) [@fredgalvao](https://discuss.elastic.co/u/fredgalvao)\ **Post date:** [April 15, 2019, 3:57pm UTC](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026/40 "2019-04-15T15:57:37Z")
You should mark the topic as fixed, I guess. Maybe even change the title to better represent that it was an incompatibility with groovy generated code, to help future developers find it easier. Also, I'm happy I could help! [Previous page](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026.md?page=1) [Next page](https://discuss.elastic.co/t/kibana-apm-not-showing-capturespan-and-capturetransaction/173026.md?page=3)