Hi guys.
I'm trying to use APM Agent on my .Net Core Webapi (.NET 6) but it's not showing the database (PostgreSQL) connection and query spans. I've setup a sample application using Visual Studio 2022 to demonstrate.
I've also spent a lot of time trying to do the same on our other .NET Framework applications but also without success, but this one let's leave it for another discussion.
The only wait i could get it to work was mannually creating the Spans, but what we need is the auto instrumentation.
Also tried to use Npgsql 6.0.0 or 5.0.0 instead of the 6.0.5
I'll leave down bellow the full IIS and APM trace logs provided by VS 2022. Thanks if anyone could help.
Kibana version: 7.13.3
Elasticsearch version: 7.13.3
APM Server version: 7.13.3
APM Agent language and version: Elastic.Apm.NetCoreAll (.NET) - 1.16.1
Browser version: N/A
Original install method (e.g. download page, yum, deb, from source, etc.) and version:
NuGet - Visual Studio 2022
Fresh install or upgraded from other version?
Server, yes, fresh install.
Is there anything special in your setup? For example, are you using the Logstash or Kafka outputs? Are you using a load balancer in front of the APM Servers? Have you changed index pattern, generated custom templates, changed agent configuration etc.
Just a simples APM setup on Docker.
Description of the problem including expected versus actual behavior. Please include screenshots (if relevant):
Expected: PostgreSQL connection query appears on transaction span, but it doesn't:
Steps to reproduce:
To reproduce i've setup a sample Visual Studio 2022 Webapi called Weather Forecast.
-
Create a new project in Visual Studio 2022. ASP.NET Core Web API:
Next Page:
Solution Created:
-
Install the modules "Elastic.Apm.NetCoreAll 1.16.1" and "Npgsql v6.0.5":
-
Setup the appsettings.conf configurations. Also set the log level to trace:
-
Configure APM in Program.cs:
-
Modify the WeatherForecastController.cs to execute a Postgresql query and return the result (query result will be 'postgres'):
-
Execute the code and run a request via Postman:
So the query get executed correctly and database connection was estabilished. -
Check the transation on APM. No query span was created and i can't see anything related to the query
select * from information_schema.tables;on the APM logs:
Errors in browser console (if relevant):
N/A
Provide logs and/or server output (if relevant):
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} Service name provided in configuration is ElasticAPM-Postgresql-Sample
Elastic.Apm: Information: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} The agent was started without a service version. The service version will be automatically discovered.
Elastic.Apm: Information: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} The agent was started without a service version. The automatically discovered service version is 1.0.0
Elastic.Apm: Debug: {SystemInfoHelper} No /proc/self/cgroup found - the agent will not report container id
Elastic.Apm: Debug: {BackendCommUtils} Building HTTP client with BaseAddress: https://apm01:8200/ for BackendCommComponentBase (PayloadSenderV2)...
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} GlobalLabels configuration option doesn't have a valid value - using default (empty map)
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} MaxQueueEventCount configuration option doesn't have a valid value - using default: 1000
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} MaxBatchEventCount configuration option doesn't have a valid value - using default: 10
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} FlushInterval configuration option doesn't have a valid value - using default: 00:00:10
Elastic.Apm: Debug: {PayloadSenderV2} Using the following configuration options: Events intake API absolute URL: https://apm01:8200/intake/v2/events, FlushInterval: 10s, MaxBatchEventCount: 10, MaxQueueEventCount: 1000
Elastic.Apm: Debug: {BackendCommComponentBase (PayloadSenderV2)} Waiting for work loop started event...
Elastic.Apm: Debug: {BackendCommComponentBase (PayloadSenderV2)} Signaling work loop started event...
Elastic.Apm: Debug: {BackendCommComponentBase (PayloadSenderV2)} Work loop started signaled
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {BackendCommUtils} Building HTTP client with BaseAddress: https://apm01:8200/ for BackendCommComponentBase (CentralConfigurationFetcher)...
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {CentralConfigurationFetcher} Central configuration feature is enabled because CentralConfig option's value is True (default value is True)
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {AbstractConfigurationReader (MicrosoftExtensionsConfig)} CentralConfig configuration option doesn't have a valid value - using default: True
Elastic.Apm: Debug: {CentralConfigurationFetcher} Combined absolute URL for APM Server get central configuration endpoint: `https://apm01:8200/config/v1/agents?service.name=ElasticAPM-Postgresql-Sample&service.environment=Development'. Service: Service{Name: ElasticAPM-Postgresql-Sample, Version: 1.0.0, Environment: Development, Runtime: Runtime{Name: .NET 6, Version: 6.0.6}, Framework: null, Agent: AgentC{Name: dotnet, Version: 1.16.1+896f164721034998eaae468029611a1195487013}, Language: null, Node: Node{ConfiguredName: null}}.
Elastic.Apm: Debug: {BackendCommComponentBase (CentralConfigurationFetcher)} Waiting for work loop started event...
Elastic.Apm: Debug: {BackendCommComponentBase (CentralConfigurationFetcher)} Signaling work loop started event...
Elastic.Apm: Debug: {BackendCommComponentBase (CentralConfigurationFetcher)} Work loop started signaled
Elastic.Apm: Trace: {CentralConfigurationFetcher} Making HTTP request to APM Server... Request: https://apm01:8200/config/v1/agents?service.name=ElasticAPM-Postgresql-Sample&service.environment=Development.
Elastic.Apm: Trace: {GcEventListener} Initialize GcEventListener to collect GC metrics
Elastic.Apm: Trace: {CgroupMetricsProvider} CgroupMetricsProvider detected a non Linux OS, therefore Cgroup metrics will not be reported
Elastic.Apm: Information: {MetricsCollector} Collecting metrics in 30000 milliseconds interval
Elastic.Apm: Trace: Initialization - Agent.Setup called. Callstack: at Elastic.Apm.Agent.Setup(AgentComponents agentComponents)
at Elastic.Apm.AspNetCore.ApmMiddlewareExtension.UseElasticApm(IApplicationBuilder builder, IConfiguration configuration, IDiagnosticsSubscriber[] subscribers)
at Program.<Main>$(String[] args)
Elastic.Apm: Debug: {HttpDiagnosticListener} Current runtime is not detected as Full Framework - returning implementation for Core. RuntimeInformation.FrameworkDescription: .NET 6.0.6
Elastic.Apm: Debug: {DiagnosticInitializer} Subscribed Elastic.Apm.DiagnosticListeners.HttpDiagnosticListenerCoreImpl to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.EntityFrameworkCore.EfCoreDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.SqlClient.SqlClientDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Elasticsearch.AuditDiagnosticsListener, Elastic.Apm.Elasticsearch.RequestPipelineDiagnosticsListener, Elastic.Apm.Elasticsearch.HttpConnectionDiagnosticsListener, Elastic.Apm.Elasticsearch.SerializerDiagnosticsListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.GrpcClient.GrpcClientDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.ServiceBus.AzureMessagingServiceBusDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.ServiceBus.MicrosoftAzureServiceBusDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureBlobStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureQueueStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureFileShareStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.MongoDb.DiagnosticSource.MongoDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.AspNetCore.DiagnosticListener.AspNetCoreErrorDiagnosticListener) that would like to subscribe to `HttpHandlerDiagnosticListener' events source
Elastic.Apm: Debug: {DiagnosticInitializer} Subscribed Elastic.Apm.AspNetCore.DiagnosticListener.AspNetCoreErrorDiagnosticListener to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.MongoDb.DiagnosticSource.MongoDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureFileShareStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureQueueStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.Storage.AzureBlobStorageDiagnosticListener, Elastic.Apm.Azure.Storage.AzureCoreDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.ServiceBus.MicrosoftAzureServiceBusDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Azure.ServiceBus.AzureMessagingServiceBusDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.GrpcClient.GrpcClientDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.Elasticsearch.AuditDiagnosticsListener, Elastic.Apm.Elasticsearch.RequestPipelineDiagnosticsListener, Elastic.Apm.Elasticsearch.HttpConnectionDiagnosticsListener, Elastic.Apm.Elasticsearch.SerializerDiagnosticsListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.SqlClient.SqlClientDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.EntityFrameworkCore.EfCoreDiagnosticListener) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {DiagnosticInitializer} There are no listeners in the current batch (Elastic.Apm.DiagnosticListeners.HttpDiagnosticListenerCoreImpl) that would like to subscribe to `Microsoft.AspNetCore' events source
Elastic.Apm: Trace: {AwsCloudMetadataProvider} Unable to get aws cloud metadata. The application is likely not running in aws
System.Net.Http.HttpRequestException: Uma operação de soquete foi tentada em uma rede inacessível. (169.254.169.254:80)
---> System.Net.Sockets.SocketException (10051): Uma operação de soquete foi tentada em uma rede inacessível.
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessage request)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Elastic.Apm.Cloud.AwsCloudMetadataProvider.GetMetadataAsync()
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Start'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing start event... Request URL: http://metadata.google.internal/computeMetadata/v1/?recursive=true
Elastic.Apm: Debug: {HttpDiagnosticListenerCoreImpl} No current transaction, skip creating span for outgoing HTTP request
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Request'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Unrecognized key `System.Net.Http.Request'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Exception'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing exception event... Request URL: http://metadata.google.internal/computeMetadata/v1/?recursive=true
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Stop'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing stop event... Request URL: http://metadata.google.internal/computeMetadata/v1/?recursive=true
Elastic.Apm: Debug: {HttpDiagnosticListenerCoreImpl} ProcessStopEvent called with no active current transaction, url: http://metadata.google.internal/computeMetadata/v1/?recursive=true - skipping event
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Response'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Event's Request property is null - exiting
Elastic.Apm: Trace: {GcpCloudMetadataProvider} Unable to get gcp cloud metadata. The application is likely not running in gcp
System.Net.Http.HttpRequestException: Este host não é conhecido. (metadata.google.internal:80)
---> System.Net.Sockets.SocketException (11001): Este host não é conhecido.
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessage request)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Elastic.Apm.Cloud.GcpCloudMetadataProvider.GetMetadataAsync()
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Start'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing start event... Request URL: http://169.254.169.254/metadata/instance/compute?api-version=2019-08-15
Elastic.Apm: Debug: {HttpDiagnosticListenerCoreImpl} No current transaction, skip creating span for outgoing HTTP request
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Request'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Unrecognized key `System.Net.Http.Request'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Exception'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing exception event... Request URL: http://169.254.169.254/metadata/instance/compute?api-version=2019-08-15
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Stop'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Processing stop event... Request URL: http://169.254.169.254/metadata/instance/compute?api-version=2019-08-15
Elastic.Apm: Debug: {HttpDiagnosticListenerCoreImpl} ProcessStopEvent called with no active current transaction, url: http://169.254.169.254/metadata/instance/compute?api-version=2019-08-15 - skipping event
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Response'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Event's Request property is null - exiting
Elastic.Apm: Trace: {AzureCloudMetadataProvider} Unable to get azure cloud metadata. The application is likely not running in azure
System.Net.Http.HttpRequestException: Uma operação de soquete foi tentada em uma rede inacessível. (169.254.169.254:80)
---> System.Net.Sockets.SocketException (10051): Uma operação de soquete foi tentada em uma rede inacessível.
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessage request)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Elastic.Apm.Cloud.AzureCloudMetadataProvider.GetMetadataAsync()
Elastic.Apm: Trace: {PayloadSenderV2} Unable to get azure-app-service cloud metadata as no WEBSITE_OWNER_NAME environment variable exists. The application is likely not running in azure-app-service
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Start'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Request URL (https://apm01:8200/) is filtered out - exiting
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Request'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Request URL (https://apm01:8200/) is filtered out - exiting
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.HttpRequestOut.Stop'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Request URL (https://apm01:8200/) is filtered out - exiting
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Called with key: `System.Net.Http.Response'
Elastic.Apm: Trace: {HttpDiagnosticListenerCoreImpl} Event's Request property is null - exiting
Logs Continue....
Logs Continue....