# How to improve performance of relevant term chart. Not loading up for large data

**URL:** <https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198>\
**Category:** Kibana\
**Created:** [November 17, 2017, 8:45pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198 "2017-11-17T20:45:17Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![priyal](https://avatars.discourse-cdn.com/v4/letter/p/74df32/32.png) [@priyal](https://discuss.elastic.co/u/priyal)\
**Post date:** [November 17, 2017, 8:45pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/1 "2017-11-17T20:45:18Z")

</div>

I am new to this elastic and kibana set up so saying sorry in advance if asking some basic questions.

I am using a 9 node cluster among which  
3 master 8gb/2cpu  
4 data 32gb/6cpu  
2 client/kibana node 16gb/4cpu

I have size of data

 ![Capture](https://us1.discourse-cdn.com/elastic/original/3X/1/e/1ed7531a98f788d0895e5939bd8cf351c174a217.PNG)

You can see the details of cluster in image.  
I am using relevant term functionality in kibana for this data. This data is over 3 months.

I am getting relevant terms in transcript field which i have analyzed removed all punctuation and stop words. For less data like for 15 days the graph loads up. when i increase it over a month the graph dosent load. How can I improve the performance of this.

For 15 days I get these results

 ![Capture1](https://us1.discourse-cdn.com/elastic/original/3X/d/e/ded0f0d19126ce39a8239ce1d9e1d3d932c8cf11.PNG)

But when i turn time to 3 months i dont get anything.

---

<div class="post-metadata">

**Author:** ![chrisronline](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/chrisronline/32/28230_2.png) [@chrisronline](https://discuss.elastic.co/u/chrisronline)\
**Post date:** [November 17, 2017, 10:02pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/2 "2017-11-17T22:02:00Z")

</div>

Hi @priyal,

Are there any errors in the developer console? Maybe look at the network requests and see if you can inspect the response and see if you can spot an error

Thanks,  
Chris

---

<div class="post-metadata">

**Author:** ![priyal](https://avatars.discourse-cdn.com/v4/letter/p/74df32/32.png) [@priyal](https://discuss.elastic.co/u/priyal)\
**Post date:** [November 17, 2017, 10:26pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/3 "2017-11-17T22:26:48Z")

</div>

@chrisronline

This is the result i get in graph for 3 months data the whole data that i have in cluster.

 ![Capture11](https://us1.discourse-cdn.com/elastic/original/3X/6/b/6b480354254f2d388ec0c2e220e79f5277992b44.PNG).  
is there any setting to improve the performance. I check the console i didn't get any error.

---

<div class="post-metadata">

**Author:** ![priyal](https://avatars.discourse-cdn.com/v4/letter/p/74df32/32.png) [@priyal](https://discuss.elastic.co/u/priyal)\
**Post date:** [November 17, 2017, 10:33pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/4 "2017-11-17T22:33:18Z")

</div>

@chrisronline  
Also if I may ask how to see network request?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 18, 2017, 7:07am UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/5 "2017-11-18T07:07:34Z")

</div>

Can you please provide the full output of the [cluster stats API](https://www.elastic.co/guide/en/elasticsearch/reference/6.0/cluster-stats.html)?

---

<div class="post-metadata">

**Author:** ![priyal](https://avatars.discourse-cdn.com/v4/letter/p/74df32/32.png) [@priyal](https://discuss.elastic.co/u/priyal)\
**Post date:** [November 20, 2017, 6:58pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/6 "2017-11-20T18:58:49Z")

</div>

@Christian_Dahlqvist here is the output 🙂

{  
"\_nodes" : {  
"total" : 9,  
"successful" : 9,  
"failed" : 0  
},  
"cluster\_name" : "Dos-Elk\_Calls\_Transcript",  
"timestamp" : 1511204161764,  
"status" : "green",  
"indices" : {  
"count" : 2,  
"shards" : {  
"total" : 12,  
"primaries" : 6,  
"replication" : 1.0,  
"index" : {  
"shards" : {  
"min" : 2,  
"max" : 10,  
"avg" : 6.0  
},  
"primaries" : {  
"min" : 1,  
"max" : 5,  
"avg" : 3.0  
},  
"replication" : {  
"min" : 1.0,  
"max" : 1.0,  
"avg" : 1.0  
}  
}  
},  
"docs" : {  
"count" : 9087383,  
"deleted" : 7  
},  
"store" : {  
"size" : "111.2gb",  
"size\_in\_bytes" : 119442086334,  
"throttle\_time" : "0s",  
"throttle\_time\_in\_millis" : 0  
},  
"fielddata" : {  
"memory\_size" : "0b",  
"memory\_size\_in\_bytes" : 0,  
"evictions" : 0  
},  
"query\_cache" : {  
"memory\_size" : "0b",  
"memory\_size\_in\_bytes" : 0,  
"total\_count" : 0,  
"hit\_count" : 0,  
"miss\_count" : 0,  
"cache\_size" : 0,  
"cache\_count" : 0,  
"evictions" : 0  
},  
"completion" : {  
"size" : "0b",  
"size\_in\_bytes" : 0  
},  
"segments" : {  
"count" : 269,  
"memory" : "168.7mb",  
"memory\_in\_bytes" : 176988517,  
"terms\_memory" : "142mb",  
"terms\_memory\_in\_bytes" : 148954745,  
"stored\_fields\_memory" : "18.8mb",  
"stored\_fields\_memory\_in\_bytes" : 19778064,  
"term\_vectors\_memory" : "3.1mb",  
"term\_vectors\_memory\_in\_bytes" : 3294112,  
"norms\_memory" : "733.5kb",  
"norms\_memory\_in\_bytes" : 751104,  
"points\_memory" : "1.9mb",  
"points\_memory\_in\_bytes" : 2095672,  
"doc\_values\_memory" : "2mb",  
"doc\_values\_memory\_in\_bytes" : 2114820,  
"index\_writer\_memory" : "0b",  
"index\_writer\_memory\_in\_bytes" : 0,  
"version\_map\_memory" : "0b",  
"version\_map\_memory\_in\_bytes" : 0,  
"fixed\_bit\_set" : "0b",  
"fixed\_bit\_set\_memory\_in\_bytes" : 0,  
"max\_unsafe\_auto\_id\_timestamp" : -1,  
"file\_sizes" : { }  
}  
},  
"nodes" : {  
"count" : {  
"total" : 9,  
"data" : 4,  
"coordinating\_only" : 2,  
"master" : 3,  
"ingest" : 4  
},  
"versions" : [  
"5.6.3"  
],  
"os" : {  
"available\_processors" : 44,  
"allocated\_processors" : 44,  
"names" : [  
{  
"name" : "Linux",  
"count" : 9  
}  
],  
"mem" : {  
"total" : "180.2gb",  
"total\_in\_bytes" : 193549418496,  
"free" : "24.6gb",  
"free\_in\_bytes" : 26420674560,  
"used" : "155.6gb",  
"used\_in\_bytes" : 167128743936,  
"free\_percent" : 14,  
"used\_percent" : 86  
}  
},  
"process" : {  
"cpu" : {  
"percent" : 0  
},  
"open\_file\_descriptors" : {  
"min" : 340,  
"max" : 398,  
"avg" : 369  
}  
},  
"jvm" : {  
"max\_uptime" : "1.6h",  
"max\_uptime\_in\_millis" : 5862031,  
"versions" : [  
{  
"version" : "1.8.0\_151",  
"vm\_name" : "Java HotSpot(TM) 64-Bit Server VM",  
"vm\_version" : "25.151-b12",  
"vm\_vendor" : "Oracle Corporation",  
"count" : 9  
}  
],  
"mem" : {  
"heap\_used" : "3gb",  
"heap\_used\_in\_bytes" : 3324930592,  
"heap\_max" : "88.6gb",  
"heap\_max\_in\_bytes" : 95179505664  
},  
"threads" : 369  
},  
"fs" : {  
"total" : "1.6tb",  
"total\_in\_bytes" : 1813068460032,  
"free" : "1.5tb",  
"free\_in\_bytes" : 1683792908288,  
"available" : "1.4tb",  
"available\_in\_bytes" : 1591481704448  
},  
"plugins" : [],  
"network\_types" : {  
"transport\_types" : {  
"netty4" : 9  
},  
"http\_types" : {  
"netty4" : 9  
}  
}  
}  
}

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 20, 2017, 9:25pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/7 "2017-11-20T21:25:13Z")

</div>

That looks pretty good. Can't see anything obviously alarming with that so far.

What does CPU and disk I/O look like on the data nodes in the cluster when you run the query over the longer time period?

---

<div class="post-metadata">

**Author:** ![priyal](https://avatars.discourse-cdn.com/v4/letter/p/74df32/32.png) [@priyal](https://discuss.elastic.co/u/priyal)\
**Post date:** [November 21, 2017, 6:12am UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/8 "2017-11-21T06:12:45Z")

</div>

@Christian_Dahlqvist its not that bad the cpu goes up to 50 to 60 % on data node when I try to load the graph for large data. after that the graph just goes out.

here is the snip

 ![Capture22](https://us1.discourse-cdn.com/elastic/original/3X/2/7/272f5143ff114ece288d81e94c5c6b02504ba3dd.PNG)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 19, 2017, 6:13am UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-relevant-term-chart-not-loading-up-for-large-data/108198/9 "2017-12-19T06:13:02Z")

</div>

Closed on December 19, 2017, 6:13am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
