# Elastic Observability

**URL:** https://discuss.elastic.co/c/observability/82.md?page=13

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 14

---

## [Correlating logs to single spans](https://discuss.elastic.co/t/correlating-logs-to-single-spans/372813)

<div class="topic-metadata">

**Author:** [@ca-schue](https://discuss.elastic.co/u/ca-schue)\
**Replies:** 0\
**Last updated:** [January 5, 2025, 4:19pm UTC](https://discuss.elastic.co/t/correlating-logs-to-single-spans/372813 "2025-01-05T16:19:09Z")

</div>

I'm currently playing around with manually instrumenting my java application. The application logs are already stored in elasticsearch. I was hoping to find something like in Jaeger where the UI allows to view span even…

---

## [Elasticsearch APM Fleet integration - index per application](https://discuss.elastic.co/t/elasticsearch-apm-fleet-integration-index-per-application/372653)

<div class="topic-metadata">

**Author:** [@fabry\_00](https://discuss.elastic.co/u/fabry_00)\
**Replies:** 3\
**Last updated:** [January 3, 2025, 5:37pm UTC](https://discuss.elastic.co/t/elasticsearch-apm-fleet-integration-index-per-application/372653 "2025-01-03T17:37:29Z")

</div>

We have an elasticsearch cluster with 4 data nodes. We have our FleetServers with APM integration enabled. We have noticed that elasticsearch creates at least an index per app / service for example: .ds-logs-apm.app.my…

---

## [ODBC SQL SELECT queries for DataStreams?](https://discuss.elastic.co/t/odbc-sql-select-queries-for-datastreams/372762)

<div class="topic-metadata">

**Author:** [@Yechezkal\_Gutfreund](https://discuss.elastic.co/u/Yechezkal_Gutfreund)\
**Replies:** 1\
**Last updated:** [January 4, 2025, 12:50am UTC](https://discuss.elastic.co/t/odbc-sql-select-queries-for-datastreams/372762 "2025-01-04T00:50:04Z")

</div>

I see that ESQL can easily be used to query a DataStream. What about the SQL queries supported by the ODBC connector? I want use the ODBC connector to look at data in my ELK Cloud stack. Thank you.

---

## [Can the output of the APM Server support HTTP?](https://discuss.elastic.co/t/can-the-output-of-the-apm-server-support-http/372314)

<div class="topic-metadata">

**Author:** [@ysj2018](https://discuss.elastic.co/u/ysj2018)\
**Replies:** 3\
**Last updated:** [January 3, 2025, 6:18pm UTC](https://discuss.elastic.co/t/can-the-output-of-the-apm-server-support-http/372314 "2025-01-03T18:18:53Z")

</div>

I have a requirement where the data from the APM Server needs to be sent directly to HTTP for subsequent processing. I couldn't find an HTTP output on the official website. However, I found someone has developed beats-o…

---

## [Documentation on synthetics.payload.timing fields?](https://discuss.elastic.co/t/documentation-on-synthetics-payload-timing-fields/372767)

<div class="topic-metadata">

**Author:** [@Yechezkal\_Gutfreund](https://discuss.elastic.co/u/Yechezkal_Gutfreund)\
**Replies:** 0\
**Last updated:** [January 3, 2025, 6:16pm UTC](https://discuss.elastic.co/t/documentation-on-synthetics-payload-timing-fields/372767 "2025-01-03T18:16:18Z")

</div>

I am looking for documentation on the units and method of collection of some of the timing values by HTTP single page synthetic monitor. The SSL values don't look right to me. It would be nice to have a timing diagram, a…

---

## [We're sending using console.log shows up in Elastic search as synthetics.payload.message but randomly disappeared for several days and we don't know why](https://discuss.elastic.co/t/were-sending-using-console-log-shows-up-in-elastic-search-as-synthetics-payload-message-but-randomly-disappeared-for-several-days-and-we-dont-know-why/372728)

<div class="topic-metadata">

**Author:** [@JustAnotherITPerson](https://discuss.elastic.co/u/JustAnotherITPerson)\
**Replies:** 0\
**Last updated:** [January 3, 2025, 1:47am UTC](https://discuss.elastic.co/t/were-sending-using-console-log-shows-up-in-elastic-search-as-synthetics-payload-message-but-randomly-disappeared-for-several-days-and-we-dont-know-why/372728 "2025-01-03T01:47:42Z")

</div>

We do some performance analysis on how long it takes to load certain elements in the page which we currently report using console.log... example, loginTime: step.soft('loginTime: Waiting for recommendations to load', as…

---

## [Windows Authentication for Synthetic Monitors in Elastic](https://discuss.elastic.co/t/windows-authentication-for-synthetic-monitors-in-elastic/372275)

<div class="topic-metadata">

**Author:** [@Sandy\_K](https://discuss.elastic.co/u/Sandy_K)\
**Replies:** 2\
**Last updated:** [January 2, 2025, 12:46pm UTC](https://discuss.elastic.co/t/windows-authentication-for-synthetic-monitors-in-elastic/372275 "2025-01-02T12:46:06Z")

</div>

Hello, I'm creating a synthetic monitor using journey for one of our applications. We have an Microsoft login authentication where after entering an email, we will get a pop-up to enter username and password. Please se…

---

## [Field documentation for ICMP, TCP and HTTP synthetic monitor](https://discuss.elastic.co/t/field-documentation-for-icmp-tcp-and-http-synthetic-monitor/372674)

<div class="topic-metadata">

**Author:** [@Yechezkal\_Gutfreund](https://discuss.elastic.co/u/Yechezkal_Gutfreund)\
**Replies:** 1\
**Last updated:** [January 2, 2025, 3:11am UTC](https://discuss.elastic.co/t/field-documentation-for-icmp-tcp-and-http-synthetic-monitor/372674 "2025-01-02T03:11:34Z")

</div>

I have been unsuccessful in hunting down some documentation on the fields returned by the synthetic monitors (specifically, I want to understand the differences between icmp.rtt.us resolve.rtt.us monitor.duration.us …

---

## [Getting Error in Creating a Workflow](https://discuss.elastic.co/t/getting-error-in-creating-a-workflow/372649)

<div class="topic-metadata">

**Author:** [@Gautam\_Pati](https://discuss.elastic.co/u/Gautam_Pati)\
**Replies:** 0\
**Last updated:** [December 31, 2024, 3:54am UTC](https://discuss.elastic.co/t/getting-error-in-creating-a-workflow/372649 "2024-12-31T03:54:47Z")

</div>

Hello, I'm working on setting up a workflow in Elastic Stack where, upon the ingestion of a log into an index, the log is sent to a Large Language Model (LLM) for processing. The LLM would then return a response, which …

---

## [I want to setup a new elasticsearch for my Organisation Please help us to setup](https://discuss.elastic.co/t/i-want-to-setup-a-new-elasticsearch-for-my-organisation-please-help-us-to-setup/372395)

<div class="topic-metadata">

**Author:** [@kishor1](https://discuss.elastic.co/u/kishor1)\
**Replies:** 3\
**Last updated:** [December 26, 2024, 1:53pm UTC](https://discuss.elastic.co/t/i-want-to-setup-a-new-elasticsearch-for-my-organisation-please-help-us-to-setup/372395 "2024-12-26T13:53:33Z")

</div>

Hi I want to setp a new Elasticsearch for my dev and pre-prod env for my organisation . please help us to setup all these thing s as we new to this Elasticsearch we don't know how much size should i use for Elasticsearc…

---

## [Microservice tracing is not showing properly](https://discuss.elastic.co/t/microservice-tracing-is-not-showing-properly/372297)

<div class="topic-metadata">

**Author:** [@haider665](https://discuss.elastic.co/u/haider665)\
**Replies:** 3\
**Last updated:** [December 24, 2024, 12:24pm UTC](https://discuss.elastic.co/t/microservice-tracing-is-not-showing-properly/372297 "2024-12-24T12:24:18Z")

</div>

I have a spring boot microservice project. I am using elk cloud instance for apm and kibana. I am using consul as service discovery, rabbitMQ for message processing and webclient for service to service communication. I…

---

## [How to extend the the page Journey object?](https://discuss.elastic.co/t/how-to-extend-the-the-page-journey-object/372345)

<div class="topic-metadata">

**Author:** [@xyngfei](https://discuss.elastic.co/u/xyngfei)\
**Replies:** 0\
**Last updated:** [December 24, 2024, 3:00am UTC](https://discuss.elastic.co/t/how-to-extend-the-the-page-journey-object/372345 "2024-12-24T03:00:59Z")

</div>

Currently, our application is required to inject the special header, and if I put the code into synthetics.config.ts, it will show the value in the elastic portal without hiding it, which is not ideal. Therefore, we expl…

---

## [Synthetics: Metrics/Stats?](https://discuss.elastic.co/t/synthetics-metrics-stats/372335)

<div class="topic-metadata">

**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\
**Replies:** 0\
**Last updated:** [December 23, 2024, 5:42pm UTC](https://discuss.elastic.co/t/synthetics-metrics-stats/372335 "2024-12-23T17:42:16Z")

</div>

Can synthetics capture all of these metrics:

---

## [APM with Serilog spamming DiagnosticsListener to normal logs](https://discuss.elastic.co/t/apm-with-serilog-spamming-diagnosticslistener-to-normal-logs/358930)

<div class="topic-metadata">

**Author:** [@Johannes\_Renatus](https://discuss.elastic.co/u/Johannes_Renatus)\
**Replies:** 3\
**Last updated:** [December 21, 2024, 6:29am UTC](https://discuss.elastic.co/t/apm-with-serilog-spamming-diagnosticslistener-to-normal-logs/358930 "2024-12-21T06:29:31Z")

</div>

Kibana version: 7.17.9 APM Server version: 8.8.1 APM Agent language and version: .net core C# =\> Elastic.Apm.NetCoreAll 1.26.0 and Serilog.Sinks.Elasticsearch 9.0.0 Description of the problem including expected ver…

---

## [APM Server transport error: error fetching APM Server version: write EPROTO](https://discuss.elastic.co/t/apm-server-transport-error-error-fetching-apm-server-version-write-eproto/372264)

<div class="topic-metadata">

**Author:** [@drms](https://discuss.elastic.co/u/drms)\
**Replies:** 0\
**Last updated:** [December 20, 2024, 9:22am UTC](https://discuss.elastic.co/t/apm-server-transport-error-error-fetching-apm-server-version-write-eproto/372264 "2024-12-20T09:22:32Z")

</div>

my server first starts up and initializes the APM service. It doesn't actually cause any issues from what I can tell and the APM starts up fine, but I'd love to understand why it's throwing this error and what I can do t…

---

## [Issues with Elastic APM "/internal/apm/services" Endpoint Versions and Parameter Changes](https://discuss.elastic.co/t/issues-with-elastic-apm-internal-apm-services-endpoint-versions-and-parameter-changes/372255)

<div class="topic-metadata">

**Author:** [@Omer\_Karabas](https://discuss.elastic.co/u/Omer_Karabas)\
**Replies:** 0\
**Last updated:** [December 20, 2024, 6:57am UTC](https://discuss.elastic.co/t/issues-with-elastic-apm-internal-apm-services-endpoint-versions-and-parameter-changes/372255 "2024-12-20T06:57:23Z")

</div>

Hello, APPLICATION\_LIST\_V7\_URL = ""/internal/apm/services?environment=ENVIRONMENT\_ALL&kuery=&start={startDate}&end={endDate}" APPLICATION\_LIST\_V8\_URL =/internal/apm/services?environment=ENVIRONMENT\_ALL&kuery=&start={st…

---

## [Logging fields with type long using logback-ecs-encoder](https://discuss.elastic.co/t/logging-fields-with-type-long-using-logback-ecs-encoder/372031)

<div class="topic-metadata">

**Author:** [@softarn](https://discuss.elastic.co/u/softarn)\
**Replies:** 1\
**Last updated:** [December 18, 2024, 1:20pm UTC](https://discuss.elastic.co/t/logging-fields-with-type-long-using-logback-ecs-encoder/372031 "2024-12-18T13:20:39Z")

</div>

I'm adding request/response logging to my Spring Boot application and I want to add, for example, the field http.request.body.bytes which is of type long. Currently we are adding the values we want to in MDC, logging an…

---

## [Elastic Serverless Forwarder Cannot Connect to my Elastic Cloud Deployment](https://discuss.elastic.co/t/elastic-serverless-forwarder-cannot-connect-to-my-elastic-cloud-deployment/371959)

<div class="topic-metadata">

**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\
**Replies:** 3\
**Last updated:** [December 13, 2024, 3:41pm UTC](https://discuss.elastic.co/t/elastic-serverless-forwarder-cannot-connect-to-my-elastic-cloud-deployment/371959 "2024-12-13T15:41:06Z")

</div>

Hello, I'm having trouble sending CloudWatch logs to Elastic Cloud via Elastic Serverless Forwarder (ESF). I've configured my config.yml per the official elastic documentation. I also enabled the DEBUG logs to add verbo…

---

## [APM Agent .NET does not work - Invalid certificate problem](https://discuss.elastic.co/t/apm-agent-net-does-not-work-invalid-certificate-problem/371829)

<div class="topic-metadata">

**Author:** [@juanmgarciaf](https://discuss.elastic.co/u/juanmgarciaf)\
**Replies:** 2\
**Last updated:** [December 13, 2024, 9:42am UTC](https://discuss.elastic.co/t/apm-agent-net-does-not-work-invalid-certificate-problem/371829 "2024-12-13T09:42:48Z")

</div>

Hello, I have a problem using an Elastic APM Agent .NET in a Windows instance. I am using the Profiler Auto Instrumentation option and I have the .NET Framework 4.8 installed in my Windows instance. I have created all e…

---

## [Dotnet profiler auto instrument not working](https://discuss.elastic.co/t/dotnet-profiler-auto-instrument-not-working/371893)

<div class="topic-metadata">

**Author:** [@ysj2018](https://discuss.elastic.co/u/ysj2018)\
**Replies:** 0\
**Last updated:** [December 12, 2024, 6:18am UTC](https://discuss.elastic.co/t/dotnet-profiler-auto-instrument-not-working/371893 "2024-12-12T06:18:26Z")

</div>

I would like to use dotnet Profiler Auto instrumentation to probe my test application developed based on the .NET Framework, but it's not working. Details about my application: The test application is developed using …

---

## [Traces arrive to apm server but dont store on elasticseach](https://discuss.elastic.co/t/traces-arrive-to-apm-server-but-dont-store-on-elasticseach/371518)

<div class="topic-metadata">

**Author:** [@alluccat](https://discuss.elastic.co/u/alluccat)\
**Replies:** 1\
**Last updated:** [December 11, 2024, 10:54am UTC](https://discuss.elastic.co/t/traces-arrive-to-apm-server-but-dont-store-on-elasticseach/371518 "2024-12-11T10:54:26Z")

</div>

Kibana version: 8.16.1 Elasticsearch version: 8.16.1 APM Server version: 8.16.1 Steps to reproduce: I am exporting the following json to the open telemetry collector { "resourceSpans": \[ { "resource"…

---

## [Elastic Serverless Forwarder Field Extraction Issue](https://discuss.elastic.co/t/elastic-serverless-forwarder-field-extraction-issue/371779)

<div class="topic-metadata">

**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\
**Replies:** 3\
**Last updated:** [December 11, 2024, 3:20am UTC](https://discuss.elastic.co/t/elastic-serverless-forwarder-field-extraction-issue/371779 "2024-12-11T03:20:05Z")

</div>

Hello, I'm currently ingesting CloudWatch logs via Kinesis \> Elastic Serverless Forwarder, but I'm having issues with injecting existing "root" fields after expanding events from JSON object lists. I've attached my conf…

---

## [AWS/CloudTrail Integration for Elastic Agent](https://discuss.elastic.co/t/aws-cloudtrail-integration-for-elastic-agent/371766)

<div class="topic-metadata">

**Author:** [@jmello31](https://discuss.elastic.co/u/jmello31)\
**Replies:** 7\
**Last updated:** [December 11, 2024, 12:38am UTC](https://discuss.elastic.co/t/aws-cloudtrail-integration-for-elastic-agent/371766 "2024-12-11T00:38:21Z")

</div>

Hello! I am using the default overarching AWS integration for Elastic Agent in order to collect CloudTrail logs from S3. I am successfully collecting logs, but I have a HUGE dataset and it is still processing logs from S…

---

## [Export APM metrics to Prometheus](https://discuss.elastic.co/t/export-apm-metrics-to-prometheus/371744)

<div class="topic-metadata">

**Author:** [@nikhil\_vippala](https://discuss.elastic.co/u/nikhil_vippala)\
**Replies:** 0\
**Last updated:** [December 10, 2024, 9:49am UTC](https://discuss.elastic.co/t/export-apm-metrics-to-prometheus/371744 "2024-12-10T09:49:41Z")

</div>

I had setup the APM (EKS) for my apps. I want to export the APM metrics primarily the throughput to the prometheus such that i can scale the application pods based on the throughput. Is there any way how i can do it? Ki…

---

## [How to upgrade apm-server processor to version 8.x](https://discuss.elastic.co/t/how-to-upgrade-apm-server-processor-to-version-8-x/371351)

<div class="topic-metadata">

**Author:** [@leyao-daily](https://discuss.elastic.co/u/leyao-daily)\
**Replies:** 4\
**Last updated:** [December 6, 2024, 2:57am UTC](https://discuss.elastic.co/t/how-to-upgrade-apm-server-processor-to-version-8-x/371351 "2024-12-06T02:57:45Z")

</div>

As the release node said in apm-server, the processor field will be removed in 8.x version. But our service is depended on the processor field, how can we upgrade to 8.x version, what is the new solution for this field.

---

## [Custom managed transaction with blocking span ends immediately](https://discuss.elastic.co/t/custom-managed-transaction-with-blocking-span-ends-immediately/371488)

<div class="topic-metadata">

**Author:** [@llibdude](https://discuss.elastic.co/u/llibdude)\
**Replies:** 1\
**Last updated:** [December 9, 2024, 10:19pm UTC](https://discuss.elastic.co/t/custom-managed-transaction-with-blocking-span-ends-immediately/371488 "2024-12-09T22:19:12Z")

</div>

I am using React and version 5.16.0 of the @elastic/apm-rum client. Goal I would like to be able to create transactions around common user workflows in my tool, such as filling out a form that requires several network …

---

## [getResourcesTags failed, skipping region us-east-1](https://discuss.elastic.co/t/getresourcestags-failed-skipping-region-us-east-1/341827)

<div class="topic-metadata">

**Author:** [@LiRi\_Elgozi](https://discuss.elastic.co/u/LiRi_Elgozi)\
**Replies:** 1\
**Last updated:** [December 9, 2024, 5:34pm UTC](https://discuss.elastic.co/t/getresourcestags-failed-skipping-region-us-east-1/341827 "2024-12-09T17:34:13Z")

</div>

I configured metricbeat to test collection info from my AWS account and the logs show me this error: Aug 28 16:59:22 heartbeat metricbeat\[74048\]: {"log.level":"info","@timestamp":"2023-08-28T16:59:22.269Z","log.logger":…

---

## [Airflow integration doesn't work properly](https://discuss.elastic.co/t/airflow-integration-doesnt-work-properly/357823)

<div class="topic-metadata">

**Author:** [@IvanovOleg](https://discuss.elastic.co/u/IvanovOleg)\
**Replies:** 2\
**Last updated:** [December 9, 2024, 3:01pm UTC](https://discuss.elastic.co/t/airflow-integration-doesnt-work-properly/357823 "2024-12-09T15:01:34Z")

</div>

Hello, I am trying to configue an integration between airflow and kibana using Airflow | Documentation (elastic.co). I deployed elasticsearch/kibana/agent/fleet-server using ECK operator. here is kibana yaml: apiVersi…

---

## [RestTemplate Calls inside another RestTemplate's ClientHttpRequestInterceptor is not seen in as a span](https://discuss.elastic.co/t/resttemplate-calls-inside-another-resttemplates-clienthttprequestinterceptor-is-not-seen-in-as-a-span/371693)

<div class="topic-metadata">

**Author:** [@Serkan\_Zengin](https://discuss.elastic.co/u/Serkan_Zengin)\
**Replies:** 4\
**Last updated:** [December 9, 2024, 2:36pm UTC](https://discuss.elastic.co/t/resttemplate-calls-inside-another-resttemplates-clienthttprequestinterceptor-is-not-seen-in-as-a-span/371693 "2024-12-09T14:36:42Z")

</div>

I have a Spring Boot application which has an endpoint /serviceCall that makes REST call to an external endpoint (for example : http localhost:8200/config/v1/agents?service.name=demo-service) via RestTemplateA. This Rest…

---

## [Error in apm java agent when using latest javalin versions](https://discuss.elastic.co/t/error-in-apm-java-agent-when-using-latest-javalin-versions/371702)

<div class="topic-metadata">

**Author:** [@ukarim](https://discuss.elastic.co/u/ukarim)\
**Replies:** 1\
**Last updated:** [December 9, 2024, 2:23pm UTC](https://discuss.elastic.co/t/error-in-apm-java-agent-when-using-latest-javalin-versions/371702 "2024-12-09T14:23:12Z")

</div>

APM Agent language and version: APM java agent. Latest stable version (co.elastic.apm:elastic-apm-agent:1.52.1) Description of the problem including expected versus actual behavior. Please include screenshots (if relev…

[Previous page](https://discuss.elastic.co/c/observability/82.md?page=12)

[Next page](https://discuss.elastic.co/c/observability/82.md?page=14)
