# Daily index vs hourly index, which is better for Search in period of month?

**URL:** https://discuss.elastic.co/t/daily-index-vs-hourly-index-which-is-better-for-search-in-period-of-month/293026
**Category:** Elasticsearch
**Tags:** docker
**Created:** [December 28, 2021, 8:36am UTC](https://discuss.elastic.co/t/daily-index-vs-hourly-index-which-is-better-for-search-in-period-of-month/293026 "2021-12-28T08:36:24Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![jr2001](https://avatars.discourse-cdn.com/v4/letter/j/e9bcb4/32.png) [@jr2001](https://discuss.elastic.co/u/jr2001)
#### Post date: [December 28, 2021, 8:36am UTC](https://discuss.elastic.co/t/daily-index-vs-hourly-index-which-is-better-for-search-in-period-of-month/293026/1 "2021-12-28T08:36:24Z")

</div>

Hi There,  
We have an indexing which is growing around 1.4 TB per day.  
this daily index have 4 million documents almost.  
each daily index has 6 primary shards and no replicas.  
we have 2 physical server (Ubuntu 20.04.2 LTS)  
server A : 3 master only node and 3 data node.  
server B : 2 master only node and 2 data node and 1 data-master eligible node.  
we used Elasticsearch 7.12.0 and nodes was done with Docker, Figured out the Java heap of 31 GB for each nodes.  
about the use case: write is heavy and indexing data currently it is running all time and is pretty fast.  
Its a platform which will be used by 100 members at least. but may not be concurrent. Search queries are performed for a period of one month.  
documents generally immutable and do not update.  
some configs for nodes are:

```auto
- "cluster.info.update.interval=2m"
- "index.merge.scheduler.max_thread_count=1"
- "http.max_content_length=1536mb"
- "index.refresh_interval=60s"
- "bootstrap.memory_lock=true"

```

What we really want to find out if, will be the hourly indexes is the better option than a single huge daily index?  
I want to thank you in advance.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [December 28, 2021, 9:33pm UTC](https://discuss.elastic.co/t/daily-index-vs-hourly-index-which-is-better-for-search-in-period-of-month/293026/2 "2021-12-28T21:33:25Z")

</div>

Welcome to our community! 😃

You'd want to test that to get a definitive answer. But given what info you have provided, I don't think it will, as larger shards are better for search.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 25, 2022, 9:34pm UTC](https://discuss.elastic.co/t/daily-index-vs-hourly-index-which-is-better-for-search-in-period-of-month/293026/3 "2022-01-25T21:34:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
