# Resource estimation for calculating Max TPS

**URL:** <https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182>\
**Category:** Kibana\
**Tags:** elastic-stack-monitoring\
**Created:** [March 26, 2024, 1:22pm UTC](https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182 "2024-03-26T13:22:16Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![tshahab](https://avatars.discourse-cdn.com/v4/letter/t/e19b73/32.png) [@tshahab](https://discuss.elastic.co/u/tshahab)\
**Post date:** [March 26, 2024, 1:22pm UTC](https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182/1 "2024-03-26T13:22:16Z")

</div>

Dear Elastic Community,

Need help regarding calculating system resource for EFK stack to calculate Max TPS.

**Current Setup:**  
Environment: Kubernetes Cluster  
Elasticsearch:

- Version: 7.17.3
- 6 Pods/Containers
- Each Pod has 2Core CPU, 4G Memory allocated.
- ES\_JAVA\_OPTS on each pod (-Xmx2g / -Xms2g). Followed [this as reference](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/advanced-configuration.html#set-jvm-heap-size).

Kibana:

- Version: 7.17.3
- 1 Pod/Container having 1Core CPU, 2G Memory

Index Template Settings:

- Number of Shards: 8
- Number of Replicas: 2

**Scenario:**  
From application logs I need to calculate MAX TPS (Transactions Per Second). Every transaction contains multiple log entries, uniquely identified by ID field in logs. I'm using Aggregation based data table. Every row contains MAX TPS of a Day. I'm aiming to calculate MAX TPS for 3 to 5 days. Using {"fixed\_interval" : "1s"} for accuracy.

**Problem Statement:**  
Whenever trying to calculate Max TPS for longer time frames (like 3 days, 7 days), kibana usually throws one of the following errors:

- Data too large
- Bucket size too large
- Shards Failed

For application/services having less traffic/logs, 1 to 3 days Max TPS can calculate with this setup but for application/service having more traffic/logs, even calculating Max TPS for the whole day (24 hours) results in one of the above-mentioned errors.

**Question:**  
How can I calculate MAX TPS for longer time frames? How can I calculate the resource needed for this scenario? Is there any thumb rule for this to estimating assigned resources for this?

Considering this for both Production and UAT environment. Any suggestions or similar case examples are appreciated.

---

<div class="post-metadata">

**Author:** ![tshahab](https://avatars.discourse-cdn.com/v4/letter/t/e19b73/32.png) [@tshahab](https://discuss.elastic.co/u/tshahab)\
**Post date:** [April 2, 2024, 7:55am UTC](https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182/2 "2024-04-02T07:55:17Z")

</div>

![data-too-large](https://us1.discourse-cdn.com/elastic/original/3X/7/8/7839f74f9f639b72a4cf8560ea8b519be8f31a2d.png)

---

<div class="post-metadata">

**Author:** ![tshahab](https://avatars.discourse-cdn.com/v4/letter/t/e19b73/32.png) [@tshahab](https://discuss.elastic.co/u/tshahab)\
**Post date:** [April 10, 2024, 6:30pm UTC](https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182/3 "2024-04-10T18:30:20Z")

</div>

Hi @Lisa_Jung,

Can you please guide me?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 8, 2024, 6:31pm UTC](https://discuss.elastic.co/t/resource-estimation-for-calculating-max-tps/356182/4 "2024-05-08T18:31:08Z")

</div>

Closed on May 8, 2024, 6:31pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.