# Performance issue on Kibana **URL:** \ **Category:** Kibana\ **Created:** [October 10, 2018, 3:56pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887 "2018-10-10T15:56:35Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 10, 2018, 3:56pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/1 "2018-10-10T15:56:35Z")
Hi Team, I have used the Dockerization concepts for my ELK implementation. Please find my ELK node infrastructure as below, ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/d/7d02df3b8684e9de5fbfa95f03255f0be8aba7a1.png) I have created around 15 dashboards. Each dashboard has around 10 to 15 visualizations. And loading more than 10K+ records in some visualization. Now, while accessing those dashboards am facing some performance issue (sometimes timeout issue occurring). When I select the more than a 1-day range in kibana it's totally down. Could someone please help me out to fix this issue. Regards, Siva.P ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 10, 2018, 9:57pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/2 "2018-10-10T21:57:26Z")
Have you identified what is limiting performance? Is it CPU? Dusk I/O and iowait? GC? ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 11, 2018, 2:28pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/3 "2018-10-11T14:28:44Z")
@Christian_Dahlqvist, Totally I have 2332 shards, 1074 Indices, 492,080,781 documents and am using X-Pack trial pack so monitored the node performance through kibana. While accessing the dashboard the elastic Search Latency is 24.8/s, Index Latency is: 0.23ms and Total shards Search Rate is 28.2/s. And that dashboard took almost 3 mins to load completely. Also, I have checked the individual docker container CPU, Mem usage as below, ![docker%20stats](https://us1.discourse-cdn.com/elastic/original/3X/2/f/2fb0a5930e74903f3dee58dd04e516444043404a.png) Could see the status in network tab ![image](https://us1.discourse-cdn.com/elastic/original/3X/e/3/e3d3cad9375133b72bba06257728b54fe52ebdd8.png) Could you please help me to analysis more on performance and fixing this issue. Thanks Siva.P ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 12, 2018, 12:56pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/4 "2018-10-12T12:56:54Z")
@Christian_Dahlqvist, Team, Could someone please help me out with the issue. Thanks Siva.P ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 12, 2018, 1:14pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/5 "2018-10-12T13:14:02Z")
Given that you only have two nodes in your cluster, your shard count sounds quite high, which could very well be contributing to your problems. Please read [this blog post](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster) for some practical guidance on shards and sharding. It would also be interesting to know what types of visualisations and aggregations you have in your dashboards. You mentioned loading 10k documents in some dashboards. Is this saved searches embedded in the dashboards? ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 12, 2018, 3:33pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/6 "2018-10-12T15:33:36Z")
@Christian_Dahlqvist. Thanks for your prompt response! I will try to add one more node to handle my shards and at the same time try to reduce the shards. And am not using the saved searches. Mostly I have used the Bar, Data table visualization. Coming to aggregation part Terms, Filters aggregation used in Buckets and TopHits aggregation in Metric. Here am attaching one of the sample Bar charts. In x-axis, I have some terms and each column trying to showcase the more than 1000 counts in the stacked view. The same way is loading more than 10K data in the data table. ![post](https://us1.discourse-cdn.com/elastic/original/3X/b/8/b84b656fdd5234b8735dc63101ef2b2b47fc66e4.png) Thanks Siva.P ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 13, 2018, 2:32pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/7 "2018-10-13T14:32:46Z")
What types of aggregations are you using? Are you using scripted fields? What does disk I/O look like while you are querying, e.g. through `iostat`? ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 15, 2018, 1:11pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/8 "2018-10-15T13:11:30Z")
@Christian_Dahlqvist, Yes, I'm using one only scripted field for achieving the color indications in the data table. The sample data table as below, ![query](https://us1.discourse-cdn.com/elastic/original/3X/1/2/12a35129234d3dfc19cdb755972bc2d9ca686ba6.png) Is there any other options/possibility to achieve the color indications ( for avoiding the scripted fields) in Kibana? And I have used the Term and sum aggregations mostly. Please find the server infrastructure details in the below and let me know that server CPU/RAM Is that fine to use as a 3rd node? ![qery2](https://us1.discourse-cdn.com/elastic/original/3X/8/a/8a8a8899afbe283e860eb1059bc5577b0587ae59.png) Thanks Siva.P ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 16, 2018, 1:18pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/9 "2018-10-16T13:18:52Z")
@Christian_Dahlqvist, Team, In the elastic end If I increase the `index.refresh_interval`, `threadpool.search.size`, `Increasing the size of the search queue` and `indices.memory.index_buffer_size` Does it improve my kibana performance? Thanks in advance! ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 18, 2018, 8:25am UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/10 "2018-10-18T08:25:31Z")
@Christian_Dahlqvist and Team, Someone, please help me out with this issue. Thanks Siva.P ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 18, 2018, 1:17pm UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/11 "2018-10-18T13:17:52Z")
> [@sivap](#): > > In the elastic end If I increase the `index.refresh_interval` , `threadpool.search.size` , `Increasing the size of the search queue` and `indices.memory.index_buffer_size` Does it improve my kibana performance? Probably not. What does disk I/O and iostat look like when querying? Is disk performance maybe the limiting factor? ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 22, 2018, 8:04am UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/12 "2018-10-22T08:04:09Z")
@Christian_Dahlqvist While accessing those dashboard I got the below response for I/O stat. > Linux 3.10.0-693.17.1.el7.x86\_64 10/22/2018 _x86\_64_ (16 CPU) > avg-cpu: %user %nice %system %iowait %steal %idle > 5.97 0.00 1.14 0.06 0.00 92.82 > Device: tps kB\_read/s kB\_wrtn/s kB\_read kB\_wrtn > dm-8 57.03 50.46 1090.49 616957805 17047994183 Thanks Siva.P ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 22, 2018, 11:22am UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/13 "2018-10-22T11:22:34Z")
@Christian_Dahlqvist, Please find the respective charts request and Query statistics as below, Data Table Visualization ![req2](https://us1.discourse-cdn.com/elastic/original/3X/7/9/796d3d3d1a51303ad028a78ee7c58b462cf260db.png) Bar chart Visualization ![req3](https://us1.discourse-cdn.com/elastic/original/3X/9/3/93bef50b2733d617b84dd74d317e0f2c933cb3e1.png) Please suggest your solutions. Thanks in advance! ---
**Author:** ![sivap](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@sivap](https://discuss.elastic.co/u/sivap)\ **Post date:** [October 23, 2018, 8:35am UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/14 "2018-10-23T08:35:00Z")
@Christian_Dahlqvist, Could you please suggest your thoughts on this. Thanks Siva.P ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 20, 2018, 8:50am UTC](https://discuss.elastic.co/t/performance-issue-on-kibana/151887/15 "2018-11-20T08:50:17Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.