# Distributed Tracing question about how to implement

**URL:** <https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734>\
**Category:** APM\
**Tags:** rum\
**Created:** [October 22, 2019, 9:39pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734 "2019-10-22T21:39:47Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ahchoo](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@Ahchoo](https://discuss.elastic.co/u/Ahchoo)\
**Post date:** [October 22, 2019, 9:39pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/1 "2019-10-22T21:39:47Z")

</div>

Hello,

I can't seem to get Distributed Tracing to work. Im starting to wonder if I don't understand Distributed Tracing correctly.

In my frontend I am creating a Transaction and a few spans to cover some JS functions. One of the JS functions makes a request to a backend Python service. I am sending the traceID from the Transaction created in the frontend as part of the request. The Python service is calling begin\_transaction and setting trace\_parent to be the traceID passed in. Backend code calls a couple methods with spans, finally ending its transaction with a response back to the frontend. The frontend then ends its transaction.

Client Transaction AAA (traceId of XXX) -\> Span BBB -\> Ajax (traceId of XXX) -\> Python begin\_transaction CCC (using traceId of XXX) -\> Python Span DDD -\> End Span DDD -\> End Transaction CCC -\> End Span BBB -\> End Transaction AAA

Hopefully that makes sense, but that is a rough chain of the calls being done and what I would expect from a distributed trace in Kibana.

Am I doing something wrong? Is there a good tutorial some has I should check out?

Thanks for the help!

EDIT:  
I should mention I see each of these individual transactions and spans in Kibana... I just don't see a single distributed trace.

---

<div class="post-metadata">

**Author:** ![axw](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/axw/32/28197_2.png) [@axw](https://discuss.elastic.co/u/axw)\
**Post date:** [October 23, 2019, 1:13am UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/2 "2019-10-23T01:13:10Z")

</div>

Hi @Ahchoo, welcome to the forum!

It sounds a bit like you're explicitly sending the trace ID from the frontend to the backend -- is that correct? The RUM JS agent automatically instruments AJAX requests, and injects trace context in the outgoing request headers, so you shouldn't need to do that.

Note that if your frontend and backend are served from different hosts, you'll need to set up CORS to allow the distributed tracing headers to be propagated. See [https://www.elastic.co/guide/en/apm/agent/rum-js/current/distributed-tracing-guide.html](https://www.elastic.co/guide/en/apm/agent/rum-js/current/distributed-tracing-guide.html) for some guidance around this.

Finally, how are you instrumenting the Python backend service? What framework are you using? If it's Django or Flask, the agent provides out of the box support for instrumenting them; see [https://www.elastic.co/guide/en/apm/agent/python/current/index.html](https://www.elastic.co/guide/en/apm/agent/python/current/index.html). If you use those, then the provided instrumentation will take care of extracting the distributed tracing headers.

---

<div class="post-metadata">

**Author:** ![Ahchoo](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@Ahchoo](https://discuss.elastic.co/u/Ahchoo)\
**Post date:** [October 23, 2019, 3:36pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/3 "2019-10-23T15:36:08Z")

</div>

Hey axw,

Yes, you are correct! I was explicitly sending the trace ID. I did not realize that there was a Parent Trace ID put into the outgoing AJAX request headers. I have made some changes to my code to use 'HTTP\_ELASTIC\_APM\_TRACEPARENT', but still not sure I am doing everything right.

I am not using Flask or Django, we are using Bottle. So I changed my code to call begin\_transaction('request', bottle.request.headers.environ.get('HTTP\_ELASTIC\_APM\_TRACEPARENT')) before every route method is called and after the route method is finished I am calling end\_transaction(bottle.request.path).

Im still not seeing a single distributed trace. I can see the frontend trace from button click and several ajax calls to the backend. I also see each of the backend calls as separate traces, but I don't see a single distributed trace. I would have expected it to be apart of the frontend trace, or some where else in Kibana, but I am not seeing it.

---

<div class="post-metadata">

**Author:** ![gil](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gil/32/41911_2.png) [@gil](https://discuss.elastic.co/u/gil)\
**Post date:** [October 23, 2019, 8:15pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/4 "2019-10-23T20:15:39Z")

</div>

To continue a distributed trace with the python client you'll want to use the `trace_parent` kwarg in the `begin_transaction` call. That value should be a `elasticapm.utils.disttracing.TraceParent`, so using your example:

```python
trace_parent = bottle.request.headers.get('Elastic-Apm-Traceparent')
begin_transaction('request', trace_parent=elasticapm.utils.disttracing.TraceParent.from_string(trace_parent)) 

```

---

<div class="post-metadata">

**Author:** ![Ahchoo](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@Ahchoo](https://discuss.elastic.co/u/Ahchoo)\
**Post date:** [October 24, 2019, 2:17pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/5 "2019-10-24T14:17:04Z")

</div>

Thank you @gil and @axw I now seem to have Distributed tracing working at least for my initial page-load request.

I'm not seeing any distributed tracing on any custom frontend transactions I start. Im trying to record from a button click (where I start a custom transaction) all the way through frontend and backend services.

EDIT:  
Ok so I think I might have partially solved my problem. I found some other posts talking about adding { managed: true } to my custom transaction on the frontend. That appears to work, distributed traces are showing up on my custom transactions now.

I now have a new issue though... The managed transaction is ending much sooner than I would like. Is there a way to control this? Or is there a way I can not use the managed flag, but still get the same results, maybe getting and setting the traceparent of a custom transaction? I would prefer to control the start and ending of transactions.

---

<div class="post-metadata">

**Author:** ![vigneshshanmugam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vigneshshanmugam/32/40324_2.png) [@vigneshshanmugam](https://discuss.elastic.co/u/vigneshshanmugam)\
**Post date:** [October 25, 2019, 9:48am UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/6 "2019-10-25T09:48:18Z")

</div>

Hi James,

As you already figured out, custom transactions does not support automatic instrumentations (XHR, Fetch, Resources) which means the user would have to start span and attach it to the transaction manually.

And yes by setting { managed: true } in the `startTransaction` option the transaction would be managed automatically which means the transaction would end as soon as current tasks(api calls) are done.

1. However you can hold of the current managed transaction from closing by adding a task and removing the task when you want to end the transaction.

```auto
const tr = apm.startTransaction('custom', 'custom', { managed: true })

const id = tr.addTask();
// the above call would make sure the transaction cannot be automatically ended till all scheduled tasks are done. 

// remove task once you are done instrumenting
tr.removeTask(id)

tr.end()

```

By this way, you are in full control of the transaction plus also you get the benefits of instrumenting other parts of code.

1. Since the above solution is not what we would like for a custom transaction, we would expose an API in the next versions to allow users to inject headers for the custom transactions/spans to make the DT work as intended. created an issue for the same - [https://github.com/elastic/apm-agent-rum-js/issues/468](https://github.com/elastic/apm-agent-rum-js/issues/468)

Thanks for the feedback and detailed info.

Cheers,  
Vignesh

---

<div class="post-metadata">

**Author:** ![Ahchoo](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@Ahchoo](https://discuss.elastic.co/u/Ahchoo)\
**Post date:** [November 7, 2019, 2:57pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/7 "2019-11-07T14:57:57Z")

</div>

Thank you @vigneshshanmugam that worked perfectly!

---

<div class="post-metadata">

**Author:** ![elastichooch](https://avatars.discourse-cdn.com/v4/letter/e/a6a055/32.png) [@elastichooch](https://discuss.elastic.co/u/elastichooch)\
**Post date:** [November 27, 2019, 9:08pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/8 "2019-11-27T21:08:38Z")

</div>

Does this mean that if I create a managed custom transaction, automatic, instrumented transactions and spans will not be attached to the trace of the custom transaction? Is there no way right now?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 18, 2019, 5:08pm UTC](https://discuss.elastic.co/t/distributed-tracing-question-about-how-to-implement/204734/9 "2019-12-18T17:08:42Z")

</div>

This topic was automatically closed 20 days after the last reply. New replies are no longer allowed.