APM with Serilog spamming DiagnosticsListener to normal logs

Elastic Observability APM
1

Kibana version:
7.17.9

APM Server version:
8.8.1

APM Agent language and version:
.net core C# => Elastic.Apm.NetCoreAll 1.26.0 and Serilog.Sinks.Elasticsearch 9.0.0

Description of the problem including expected versus actual behavior. Please include screenshots (if relevant):

I've registered apm in program.cs
app.UseAllElasticApm(app.Configuration);

I am also using Serilog and logging all my Application Logs to ES with Serilog.
That works all fine. But since I am using APM it registered a lot of "HttpDiagnosticsSubscriber" on startup and my current debuglog on my console and on the ES Server in my Application Log looks like:

[15:30:43 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Start event from elasticsearch
[15:30:43 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Start event from elasticsearch
[15:30:43 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Stop event from elasticsearch
[15:30:43 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Start event from elasticsearch
[15:30:43 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Stop event from elasticsearch
[15:30:43 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Stop event from elasticsearch
[15:30:45 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Start event from elasticsearch
[15:30:45 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Start event from elasticsearch
[15:30:46 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Stop event from elasticsearch
[15:30:46 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Start event from elasticsearch
[15:30:46 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Stop event from elasticsearch
[15:30:46 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Stop event from elasticsearch
[15:30:48 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Start event from elasticsearch
[15:30:48 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Start event from elasticsearch
[15:30:48 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Stop event from elasticsearch
[15:30:48 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Start event from elasticsearch
[15:30:48 INF] {HttpConnectionDiagnosticsListener} Received an ReceiveBody.Stop event from elasticsearch
[15:30:48 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Stop event from elasticsearch
[15:30:50 INF] {RequestPipelineDiagnosticsListener} Received an CallElasticsearch.Start event from elasticsearch
[15:30:50 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Start event from elasticsearch
[15:30:50 INF] {HttpConnectionDiagnosticsListener} Received an SendAndReceiveHeaders.Stop event from elasticsearch

It spams my hole Application log. Is there a way to disable this kind of logs for my Application ES Log Index?

I've tried to Override this in the appsettings.json but its not working:

{
  "AppName": "automation-api",
  "Serilog": {
    "MinimumLevel": {
      "Default": "Information",
      "Override": {
        "Microsoft": "Warning",
        "System.Net.Http.HttpClient": "Warning",
        "System": "Warning",
        "*HttpHandlerDiagnosticListener*": "Warning",
        "*RequestPipelineDiagnosticsListener*": "Warning"
      }
    }
  },
  "ElasticApm": {
    "ServerUrl": "https://elastic-apm.local.com",
    "ServiceName": "automation-api",
    "Environment": "development",
    "TransactionSampleRate": 1.0,
    "LogLevel": "Debug",
    "CaptureBody": "errors"
  },
  "AllowedHosts": "*"
}
2

The problem is that we use the nuget "Serilog.Sinks.Elasticsearch" which is not from ES itself and this makes this passive Problems.

We Megrated to Elastic.Serilog.Sinks and this solved our Problem

3

Hi,

How can we pass the extra configuration (including API Key for ES authentication) while using Elastic.Serilog.Sinks?

Thanks,

4 
loggerConfiguration.WriteTo.Elasticsearch(new ElasticsearchSinkOptions(new Uri(elasticUrl))
{
    ModifyConnectionSettings = (c) =>
        c.ServerCertificateValidationCallback((sender, certificate, chain, errors) => true)
            .BasicAuthentication("serilog", "123y1easSbDWa2w"),
    FormatStackTraceAsArray = true,
    RegisterTemplateFailure = RegisterTemplateRecovery.IndexAnyway,
    IndexFormat = $"applog-{appName}-{environment}-{{0:yyyy.MM.dd}}",
    PipelineName = "application-applog",
    BufferRetainedInvalidPayloadsLimitBytes = 5000,
    BatchPostingLimit = 50,
    DetectElasticsearchVersion = true,
    EmitEventFailure = EmitEventFailureHandling.WriteToSelfLog,
    TypeName = null
});