# Dedicated ml index for apm high\_mean\_transaction\_duration

**URL:** <https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411>\
**Category:** Kibana\
**Tags:** elastic-stack-machine-learning\
**Created:** [November 5, 2020, 1:29pm UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411 "2020-11-05T13:29:21Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [November 5, 2020, 1:29pm UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411/1 "2020-11-05T13:29:21Z")

</div>

Hello,

Currently the auto-created ml job apm-pr-d40c-high\_mean\_transaction\_duration saves it's model in the shared ml index. This is problematic, as this index contains sensitive information which we cannot open for developers.

So is it possible to migrate this to a dedicated ml index and use index level privileges? Or do we have to provide granular field-level access controls on job\_id in .ml-anomalies-shared?

Also, although the job has been created and run over a period of +- last 60 days, APM does not show any detected anomalies:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/f/b/fb45453290ca2ae1c7eabde30cd25924486c1064.png)

When I click on View job, it goes to the configured job:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/9/f/9fcaeadd93c6e5ccd70c6e865ef9c9dd77dc908a.png)

I was expecting similar integration as in Uptime, where anomalies are shown as red vertical annotation lines? 27/10, there was an anomaly which was higher then 75.

Grtz

Willem

---

<div class="post-metadata">

**Author:** ![wei.wang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wei.wang/32/51803_2.png) [@wei.wang](https://discuss.elastic.co/u/wei.wang)\
**Post date:** [November 5, 2020, 8:38pm UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411/2 "2020-11-05T20:38:31Z")

</div>

Hi Willem,

Two things are being discussed here.

**1. The permission about ml jobs result.**

We currently are working on [Integration with Kibana Spaces](https://github.com/elastic/kibana/issues/64172), with that being implemented (now is planed for 7.11 release), you will be able to use Kibana Spaces/Indicies feature to solve your problem. Unfortunately at the moment we don’t have a good way to restrict certain users to only view the results of certain jobs.

**2. APM does not show any detected anomalies.**

[APM](https://discuss.elastic.co/c/observability/apm/58) channel might be a good place to ask around. I also did a quick search in Github, this might be what you are looking for: [https://github.com/elastic/kibana/issues/52250](https://github.com/elastic/kibana/issues/52250) . As it is marked as enhancement, we might haven't decided when to implement it yet.

Cheers and stay safe.

Wei

---

<div class="post-metadata">

**Author:** ![willemdh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/willemdh/32/16922_2.png) [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Post date:** [November 5, 2020, 9:25pm UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411/3 "2020-11-05T21:25:31Z")

</div>

Thanks @wei.wang for your answer.

Good to know ML - Kibana Space integration is on the roadmap. 🙂

My point of issue 2 was that I don't see any annotation at all, although there is definitely an anomaly. (Sry, I should have opened this in APM section)

The issue [https://github.com/elastic/kibana/issues/52250](https://github.com/elastic/kibana/issues/52250) seems more about adding the annotations and plot tot the legend?

---

<div class="post-metadata">

**Author:** ![wei.wang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wei.wang/32/51803_2.png) [@wei.wang](https://discuss.elastic.co/u/wei.wang)\
**Post date:** [November 6, 2020, 1:40am UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411/4 "2020-11-06T01:40:26Z")

</div>

Hmm, yes, an annotation should be seen on your "APM - Transaction duration" since the anomaly score is 88 which is above 75. Please ask this in APM channel, where you can get better answer.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 4, 2020, 1:40am UTC](https://discuss.elastic.co/t/dedicated-ml-index-for-apm-high-mean-transaction-duration/254411/5 "2020-12-04T01:40:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
