No Service Found in APM DATA

[Sam_1995 (Sameer)]

No Service Found in APM DATA in Kibana even though data is present in apm* index and could application apm data received in apm-server logs

Kibana version:
7.17.9
Elasticsearch version:
7.17.9
APM Server version:
7.17.9
APM Agent language and version:
JAVA

Steps to reproduce:
1.
2.
3.

Errors in browser console (if relevant):

Provide logs and/or server output (if relevant):
APM Config.yaml given below

apm-server:
host: "0.0.0.0:8200"
kibana:
host: "localhost:5601"
protocol: "https"
username: ""
password: ""
ssl.verification_mode: none
setup.template.name: "apm-server"
setup.template.pattern: "apm-*"
output.elasticsearch:
hosts: ["localhost:9200"]
protocol: "https"
username: ""
password: ""
ssl.verification_mode: none
enabled: true
indices:
- index: "apm-%{[observer.version]}-sourcemap"
when.contains:
processor.event: "sourcemap"

- index: "apm-%{[observer.version]}-error-%{+yyyy.MM.dd}"
  when.contains:
    processor.event: "error"

- index: "apm-%{[observer.version]}-transaction-%{+yyyy.MM.dd}"
  when.contains:
    processor.event: "transaction"

- index: "apm-%{[observer.version]}-span-%{+yyyy.MM.dd}"
  when.contains:
    processor.event: "span"

- index: "apm-%{[observer.version]}-metric-%{+yyyy.MM.dd}"
  when.contains:
    processor.event: "metric"

- index: "apm-%{[observer.version]}-onboarding-%{+yyyy.MM.dd}"
  when.contains:
    processor.event: "onboarding"

ssl.enabled: true
logging.level: info
logging.to_files: true
logging.files:
path: /var/log/apm-server
name: apm-server
keepfiles: 7
permissions: 0600

Let me know if anything else is required

[Sylvain_Juge]

Hi @Sam_1995 ,

The Java APM agent seems to properly able to communicate with APM Server, and the documents are written to Elasticsearch, which means it does not look like a communication issue, either between APM agent and APM server or between APM server and Elasticsearch.

The Java APM agent sends some JVM metrics whenever it is started, so even if there is no activity on the application you should see a service and some JVM metrics in the UI within a few minutes of starting the application.

I am not very familiar with all the apm-server configuration options, but it seems plausible to be the issue here. From what I know starting with a very minimal apm-server configuration like this could help:

apm-server:
  host: "localhost:8200"

output.elasticsearch:
  hosts: ["localhost:9200"]
  protocol: "https"
  username: ''
  password: ''

[Sam_1995 (Sameer)]

Hi @Sylvain_Juge

Tried with minimal configurations as well but still facing this issue.

[Sylvain_Juge]

Hi !

Can you search for sample documents that have service.name in discover ?

I really don't know what could be the issue here, I am really not an expert with APM server or UI, which explains why I'd like to check the data first before trying to find someone who can help here.

[Sam_1995 (Sameer)]

Hi

In discover for apm index below is the screenshot of documents having service.name