Trace id and Transaction id getting inserted but Nothing shown in Stream tab

If you are asking about a problem you are experiencing, please use the following template, as it will help us help you. If you have a different problem, please delete all of this text :slight_smile:

TIP 1: select at least one tag that further categorizes your topic. For example server for APM Server related questions, java for questions regarding the Elastic APM Java agent, or ui for questions about the APM App within Kibana.

TIP 2: Check out the troubleshooting guide first. Not only will it help you to resolve common problems faster but it also explains in more detail which information we need before we can properly help you.

Kibana version:7.12.0

Elasticsearch version:7.12.0

APM Server version:7.12.0

APM Agent language and version:Java/1.22.0

Browser version:chrome

Original install method (e.g. download page, yum, deb, from source, etc.) and version:download tar and extracted on local standalone cluster

Fresh install or upgraded from other version? : NO

Description of the problem including expected versus actual behavior. Please include screenshots (if relevant):
Here is arguments of apm agent : -javaagent:/Users/gaurav.arya/Downloads/jolokia-jvm-1.6.2-agent.jar -javaagent:/Users/gaurav.arya/Downloads/elastic-apm-agent-1.22.0.jar -Delastic.apm.service_name=coherence -Delastic.apm.application_packages=com.payu -Delastic.apm.server_url=http://localhost:8200 -Delastic.apm.enable_log_correlation=true -Delastic.apm.log_ecs_reformatting=SHADE

Here is the elasticsearch document which has trace.id and transaction.id

        {
  "took" : 15,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [
      {
        "_index" : "apm-7.12.0-transaction-000002",
        "_type" : "_doc",
        "_id" : "OwMXlnkBObZRv0qMPe6F",
        "_score" : null,
        "_source" : {
          "agent" : {
            "name" : "java",
            "ephemeral_id" : "2decd893-2b72-4781-b29c-6c0e6e5b0093",
            "version" : "1.22.0"
          },
          "process" : {
            "pid" : 21001,
            "title" : "/Users/gaurav.arya/Downloads/jdk8u275-full.jdk/jre/bin/java"
          },
          "source" : {
            "ip" : "::1"
          },
          "processor" : {
            "name" : "transaction",
            "event" : "transaction"
          },
          "url" : {
            "path" : "/nodal/statement/processing/fetchTaggedEntries",
            "scheme" : "http",
            "port" : 8080,
            "domain" : "localhost",
            "full" : "http://localhost:8080/nodal/statement/processing/fetchTaggedEntries"
          },
          "observer" : {
            "hostname" : "administrators-MacBook-Pro.local",
            "id" : "0e20ffbd-3144-462b-9b57-ee69abc0b6d3",
            "type" : "apm-server",
            "ephemeral_id" : "53a7fbfa-1945-4926-a403-95930a1c2bc0",
            "version" : "7.12.0",
            "version_major" : 7
          },
          "trace" : {
            "id" : "e67446925f020202a7499dfa23b30568"
          },
          "@timestamp" : "2021-05-22T21:59:26.217Z",
          "ecs" : {
            "version" : "1.8.0"
          },
          "service" : {
            "node" : {
              "name" : "administrators-MacBook-Pro.local"
            },
            "framework" : {
              "name" : "Spring Web MVC",
              "version" : "4.1.6.RELEASE"
            },
            "name" : "coherence",
            "runtime" : {
              "name" : "Java",
              "version" : "1.8.0_275"
            },
            "language" : {
              "name" : "Java",
              "version" : "1.8.0_275"
            }
          },
          "host" : {
            "hostname" : "administrators-MacBook-Pro.local",
            "os" : {
              "platform" : "Mac OS X"
            },
            "ip" : "127.0.0.1",
            "name" : "administrators-MacBook-Pro.local",
            "architecture" : "x86_64"
          },
          "client" : {
            "ip" : "::1"
          },
          "http" : {
            "request" : {
              "headers" : {
                "Accept" : [
                  "application/json"
                ],
                "Cache-Control" : [
                  "no-cache"
                ],
                "Connection" : [
                  "keep-alive"
                ],
                "User-Agent" : [
                  "PostmanRuntime/7.26.8"
                ],
                "Postman-Token" : [
                  "[REDACTED]"
                ],
                "Host" : [
                  "localhost:8080"
                ],
                "Accept-Encoding" : [
                  "gzip, deflate, br"
                ],
                "Content-Length" : [
                  "220"
                ],
                "Content-Type" : [
                  "application/json"
                ]
              },
              "method" : "POST",
              "socket" : {
                "encrypted" : false,
                "remote_address" : "0:0:0:0:0:0:0:1"
              },
              "body" : {
                "original" : "[REDACTED]"
              }
            },
            "response" : {
              "headers" : {
                "Transfer-Encoding" : [
                  "chunked"
                ],
                "Cache-Control" : [
                  "no-store, no-cache, must-revalidate, max-age=0, post-check=0, pre-check=0"
                ],
                "Expires" : [
                  "Mon, 23 May 2016 06:00:00 GMT"
                ],
                "Last-Modified" : [
                  "Sun May 23 03:29:26 IST 2021"
                ],
                "Pragma" : [
                  "no-cache"
                ],
                "Date" : [
                  "Sat, 22 May 2021 21:59:27 GMT"
                ],
                "Content-Type" : [
                  "application/json"
                ]
              },
              "status_code" : 200,
              "finished" : true,
              "headers_sent" : true
            },
            "version" : "1.1"
          },
          "event" : {
            "ingested" : "2021-05-22T21:59:36.064026Z",
            "outcome" : "success"
          },
          "transaction" : {
            "duration" : {
              "us" : 1561927
            },
            "result" : "HTTP 2xx",
            "name" : "PaPgNodalStatementController",
            "span_count" : {
              "dropped" : 0,
              "started" : 6
            },
            "id" : "2a5239a7d67a662d",
            "type" : "request",
            "sampled" : true
          },
          "user_agent" : {
            "original" : "PostmanRuntime/7.26.8",
            "name" : "Other",
            "device" : {
              "name" : "Other"
            }
          },
          "timestamp" : {
            "us" : 1621720766217051
          }
        },
        "sort" : [
          1621720766217
        ]
      }
    ]
  }
}


Hers is the screenshot showing no data.

Rest of the configurations are default and no change has been done.

Hi @gaurav9620

APM documents are not shown in the Logs UI by default as technically the are not logs they are APM transactions, spans etc.

If you want to see them you should go looks in Discover and look with the apm-* index pattern they will be there.

I suspect you are actually trying to do correlated logs by looking at your config above, those app logs would have the trace.id and transaction.id injected in them if properly configured but you will still need need to ship your logs to elasticshearch using something like filebeat as the APM agent does not ship the application logs it just helps with injecting the correlations ids.

So you need to use Filebeat or something else to ship the actual app logs to Elasticsearch. Then those logs will show up in the the Log Stream UI with the correct correlated ids.

Hope this helps.

This topic was automatically closed 20 days after the last reply. New replies are no longer allowed.