# How to get the daily amount of logs in GB

**URL:** <https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378>\
**Category:** Kibana\
**Created:** [March 14, 2019, 4:08pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378 "2019-03-14T16:08:02Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![npalanis](https://avatars.discourse-cdn.com/v4/letter/n/e5b9ba/32.png) [@npalanis](https://discuss.elastic.co/u/npalanis)\
**Post date:** [March 14, 2019, 4:08pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/1 "2019-03-14T16:08:02Z")

</div>

Hi there,

I'm trying to get what GB amount of logs we get each day across each of the ELK datacenters?  
But on the kibana dashboard, I could see only the list of indices with minimal sizes in MB and KB.  
So could you please help me to find the above pieces of information?  
Thanks in advance.

---

<div class="post-metadata">

**Author:** ![jbudz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jbudz/32/45922_2.png) [@jbudz](https://discuss.elastic.co/u/jbudz)\
**Post date:** [March 14, 2019, 5:55pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/2 "2019-03-14T17:55:41Z")

</div>

Kibana dashboards don't have an easy way to do meta analysis of the data, it typically searches based on the contents of data. We could graph the number of documents, and maybe do some extrapolation.

At a low level, something like [https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-indices.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-indices.html) or the Monitoring application may be options.

Would any of these work for you?

---

<div class="post-metadata">

**Author:** ![npalanis](https://avatars.discourse-cdn.com/v4/letter/n/e5b9ba/32.png) [@npalanis](https://discuss.elastic.co/u/npalanis)\
**Post date:** [March 14, 2019, 6:04pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/3 "2019-03-14T18:04:13Z")

</div>

Hi Jon,

thanks for the reply.  
actually I tried that one, but my requirement is to get the total number of log size details that generate on daily basis(particularly in GB).  
also I seen in this forum where people are saying :  
in the below link the user had mentioned the line

> [@How to limit amount of incoming data](https://discuss.elastic.co/t/how-to-limit-amount-of-incoming-data/68683):
>
> To collect and analyze our logfiles from 15 server we use elasticsearch 2.4.2, logstash 2.4.0, kibana 4.6.1 and filebeat and everything works fine. In normal case the size of our daily indexes is about 1GB. Last week, the size of the daily log was many times higher than the normal case on 6 server (30-40GB on each server). As a result the cluster state changes to red, because there was no disk space. Is it possible to prevent such a case? It was a really unexpected behaviour.

( the size of the daily log was many times higher than the normal case on 6 server (30-40GB on each server).

---

<div class="post-metadata">

**Author:** ![A\_B](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/a_b/32/17104_2.png) [@A\_B](https://discuss.elastic.co/u/A_B)\
**Post date:** [March 15, 2019, 4:25pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/4 "2019-03-15T16:25:32Z")

</div>

> [@npalanis](#):
>
> the size of the daily log was many times higher than the normal case on 6 server (30-40GB on each server

I read that as the size of the local log files on 6 specific servers, not as the indexed size of the logs in Elasticsearch...

Anyway, if you have daily indices in Elasticseaech, Kibana will show the size of each index in _Monitoring_. How do you _shard_ or split up your Elasticsearch indices?

---

<div class="post-metadata">

**Author:** ![npalanis](https://avatars.discourse-cdn.com/v4/letter/n/e5b9ba/32.png) [@npalanis](https://discuss.elastic.co/u/npalanis)\
**Post date:** [March 19, 2019, 1:26pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/5 "2019-03-19T13:26:27Z")

</div>

thanks for the reply.  
We have the weekly indices.  
example:  
GET /\_cat/indices  
green open logstash-i-node-2019.04 ovWNhA 1 1 7710 0 2.3mb 1.1mb  
green open logstash-lp-web-2019.02 cgcyP6A 1 1 2311271 0 1.4gb 754.8mb  
green open logstash-ir-spark-2019.11 sUrgLxw 1 1 7848132 0 3.9gb 2gb

could you tell me based on this, how can i get the total amount of logs that flow into kibana daily (in GB format)?  
also when you say that (I read that as the size of the local log files on 6 specific servers) , you meant the size of the logs directory from each server? if so, how you find the size on daily basis?please

---

<div class="post-metadata">

**Author:** ![A\_B](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/a_b/32/17104_2.png) [@A\_B](https://discuss.elastic.co/u/A_B)\
**Post date:** [March 19, 2019, 2:21pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/6 "2019-03-19T14:21:43Z")

</div>

> [@npalanis](#):
>
> also when you say that (I read that as the size of the local log files on 6 specific servers) , you meant the size of the logs directory from each server? if so, how you find the size on daily basis?

I guess I just misunderstood your question...

You can get the column headings from the indices API using `?v` for verbose

```
GET /_cat/indices?v

```

Second to last column is `store.size` and last column is `pri.store.size`. I'm guessing a bit but I think `pri.store.size` is the total size of the primary shards of the index and `store.size` is the total size of _all_ shards of the index. So to get an estimated log volume per day take the sum of `store.size` for all indices and divide by 7.

I'm sure there would be a better way as well but this is not something I have really looked into...

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 16, 2019, 2:21pm UTC](https://discuss.elastic.co/t/how-to-get-the-daily-amount-of-logs-in-gb/172378/7 "2019-04-16T14:21:47Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
