# Kibana APM App pages are TOO SLOW **URL:** \ **Category:** APM\ **Tags:** ui\ **Created:** [February 24, 2020, 2:58am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570 "2020-02-24T02:58:05Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [February 24, 2020, 2:58am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/1 "2020-02-24T02:58:05Z")
Kibana APM App pages are too slow with only 1000 tps transaction data. Elasticsearch is installed on 10 'n1-highcpu-16' nodes on Google Compute Engine. I captured the screen to see the loading latency. > **[ElasticAPM\_LatencyIssue.mp4 (video)](https://drive.google.com/file/d/14j-nzJOHUZb5ZcRG3IaQo9qiVzKnIkZ2/view?usp=drive_open)** > > Google Drive file. **Kibana version** : 7.5.0~7.6.0 **Elasticsearch version** : 7.5.0~7.6.0 **APM Server version** : 7.5.0~7.6.0 **APM Agent language and version** : java **Browser version** : Chrome (80.0.3987.116 (64bit)) **Original install method (e.g. download page, yum, deb, from source, etc.) and version**: ECK, download page. **Fresh install or upgraded from other version?** 7.5.0 (Fresh install) 7.6.0 (upgraded from 7.5.0) **Is there anything special in your setup?** For example, are you using the Logstash or Kafka outputs? Are you using a load balancer in front of the APM Servers? Have you changed index pattern, generated custom templates, changed agent configuration etc. - Index Pattern : - primary shard : 5 - refresh interval : 10s - sample rate : 0.01 **Description of the problem including expected versus actual behavior. Please include screenshots (if relevant)**: **Steps to reproduce** : 1. Keep call the service with 1000 tps load. 2. wait for 24 hours for the apm data load to the elasticsearch nodes. 3. Open Kibana apm pages. It take more than 20seconds for loading most of APM pages. 4. The issue can be reproduced with 100% possibility on any environment. - eck / 10 nodes(16core, 16G ram)/5 primary shard, 1replica - normal / 10 nodes(16core, 16G ram)/5 primary shard, 1replica **Errors in browser console (if relevant)**: it took more than 20seconds to load every APM page. **Provide logs and/or server output (if relevant)**: - screen capture : [https://drive.google.com/open?id=14j-nzJOHUZb5ZcRG3IaQo9qiVzKnIkZ2](https://drive.google.com/open?id=14j-nzJOHUZb5ZcRG3IaQo9qiVzKnIkZ2) ---
**Author:** ![sqren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sqren/32/26110_2.png) [@sqren](https://discuss.elastic.co/u/sqren)\ **Post date:** [February 24, 2020, 10:38am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/2 "2020-02-24T10:38:46Z")
Hi there, Thanks for the good description and screen capture. It clearly looks very slow. To get more insights into the slow requests you should enable some additional debugging. By appending `&_debug=true` to the url of the slow request, the exact Elasticsearch query that is executed will be logged in the Kibana process. Example: /api/apm/services?start=2020-02-23T11%3A50%3A01.650Z&end=2020-02-24T11%3A50%3A01.650Z&uiFilters=%7B%7D& **\_debug=true** Please copy the ES query into Kibana Dev Tools and verify whether it's still performing poorly, then post the query here. Thank you. ---
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [February 26, 2020, 1:44am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/3 "2020-02-26T01:44:52Z")
Hello, I tried what you said to find the cause of the slow loading time. However, every queries in the Kibana APM App seems to very slow. I captured all queries and made a google sheet. [Elastic APM Slow Queries Google Sheet](https://docs.google.com/spreadsheets/d/1zBdXm1AttrwO52cAihk9eEdUuitQBdNZFbLC7Bk_Dy8/edit?usp=sharing) All data is on 'Time' sheet, and on Page1, Page2, Page3 sheets I put a captured Kibana screen with Chrome dev tool result. One more thing I want to ask is, I found [THIS APM Issue](https://github.com/elastic/apm/issues/104) on APM project, and this issue is quite related to the APM latency problem. Is it right? ---
**Author:** ![sqren](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sqren/32/26110_2.png) [@sqren](https://discuss.elastic.co/u/sqren)\ **Post date:** [February 26, 2020, 2:25pm UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/4 "2020-02-26T14:25:56Z")
Thanks for capturing this information. Much appreciated! I'll need a bit of time to look into it. > I found [THIS APM Issue](https://github.com/elastic/apm/issues/104) on APM project, and this issue is quite related to the APM latency problem. Is it right? Yes, absolutely. That's one approaches we are looking into to making the IU faster. ---
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [February 26, 2020, 3:07pm UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/5 "2020-02-26T15:07:44Z")
Okay 🙂 Take your time, and I hope you to find the cause of the problem. ---
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [March 4, 2020, 5:34am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/6 "2020-03-04T05:34:01Z")
Hello @sqren Any updates on this issue? ---
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [March 16, 2020, 4:33am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/7 "2020-03-16T04:33:28Z")
Adding related issues - [APM UI Kibana Internal Server Error](https://discuss.elastic.co/t/apm-ui-kibana-internal-server-error/223601) - [APM Queue is full](https://discuss.elastic.co/t/apm-queue-is-full/221513/11) ---
**Author:** ![Rakesh\_B](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rakesh_b/32/48128_2.png) [@Rakesh\_B](https://discuss.elastic.co/u/Rakesh_B)\ **Post date:** [March 18, 2020, 2:43pm UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/8 "2020-03-18T14:43:55Z")
Hi, This issue might be helpful to you - [APM transaction data not compressed properly](https://discuss.elastic.co/t/apm-transaction-data-not-compressed-properly/224030/4). APM is planning to release a fix in 7.8 - [https://github.com/elastic/apm-server/issues/3485](https://github.com/elastic/apm-server/issues/3485) ---
**Author:** ![Bingu\_Shim](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bingu_shim/32/57949_2.png) [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Post date:** [March 18, 2020, 3:13pm UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/9 "2020-03-18T15:13:23Z")
Thanks you ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [April 8, 2020, 11:13am UTC](https://discuss.elastic.co/t/kibana-apm-app-pages-are-too-slow/220570/10 "2020-04-08T11:13:28Z")
This topic was automatically closed 20 days after the last reply. New replies are no longer allowed.