Trace_methods not tracing methods for Java application deployed in weblogic

[Vineet0211 (Vineet Sharma)]

If you are asking about a problem you are experiencing, please use the following template, as it will help us help you. If you have a different problem, please delete all of this text

Kibana version: 7.6.2

Elasticsearch version: 7.6.2

APM Server version: 7.6.2

APM Agent language and version:

Browser version: Chrome

Original install method (e.g. download page, yum, deb, from source, etc.) and version:download page

Fresh install or upgraded from other version?
Fresh install
Is there anything special in your setup? For example, are you using the Logstash or Kafka outputs? Are you using a load balancer in front of the APM Servers? Have you changed index pattern, generated custom templates, changed agent configuration etc.
No
Description of the problem including expected versus actual behavior. Please include screenshots (if relevant):

Steps to reproduce:

1. configure Elasticsearch, Kibana, APM-Server and apm-agent(in weblogic)
2. configure weblogic startup with java below options
   export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.server_urls=http://10.XX.XX.XX:8200" export JAVA_OPTIONS="$JAVA_OPTIONS -javaagent:/users/gen/XXX/JEE/XXX/XXX/XXX/lib/elastic-apm-agent.jar" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.service_name=CRM_Services" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.instrument=true" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.environment=Local_Env" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.capture_body=true" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.application_packages=com.clxxy,com.axxxxs,axxxxs.bpm,com.cxxhd,axxxxs.uxxsx,com.cxxglx,cxx.crmimpl" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.trace_methods=com.clxxxy.*,com.axxxs.*,axxxxs.bpm.*,com.cxxxd.*,axxxxs.uxxx.*,com.cxxxlx.*,com.cxxxl.*" export JAVA_OPTIONS="$JAVA_OPTIONS -Delastic.apm.enable_log_correlation=true"

Errors in browser console (if relevant):

Provide logs and/or server output (if relevant):

Only getting below 2 entries:

[Eyal_Koren]

Welcome to the forum Vineet!

Your configuration seems correct. Please set log level to debug and see if you find anything interesting.

Regardless, an important advice: it seems you are attempting to capture all methods of entire packages using the trace_methods configuration. You should be aware that while each traced method execution adds very little to the agent overhead (and results in one indexed document), such instrumentation may increase overhead greatly. It is enough to instrument one method that is executed very frequently to cause this. Moreover, your traces may become not-so-useable if they are too big, which is why we limit the number of spans per transaction by default.

I suggest you take a look at our method monitoring guide, and specifically the new sampling profiling feature. Since it is still experimental, it is off by default and can be switched on through the profiling_inferred_spans_enabled config.