# Dynamic Shards (Incremental Resharding)

**URL:** https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801
**Category:** Elasticsearch
**Created:** [June 7, 2019, 6:16pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801 "2019-06-07T18:16:27Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![panda2004](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/panda2004/32/19473_2.png) [@panda2004](https://discuss.elastic.co/u/panda2004)
#### Post date: [June 7, 2019, 6:16pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801/1 "2019-06-07T18:16:27Z")

</div>

Hello everyone,

One of the most common challenges with big data is dealing with increasing volume of data. The traditional solution in ElasticSearch is dynamically creating new indices - which means that the latest documents are found in the new created indices. This allows implementing [Hot/Warm Architecture](https://www.elastic.co/blog/implementing-hot-warm-cold-in-elasticsearch-with-index-lifecycle-management) with built-in mechanism like rollover index and index lifecycle management.

I wounder: **Instead of dynamically creating new indices, is there a way of dynamically creating new shards?** This approach is supported in Solr: there is an [API](https://lucene.apache.org/solr/guide/6_6/collections-api.html#CollectionsAPI-createshard) for creating new **empty** shards in existing index. Is there any way to do so in ElasticSearch? I haven't seen any API allowing creating new shards dynamically as solr implemented. Only noticed [shrinking](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-shrink-index.html) index to lower shards or [splitting](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-split-index.html) index to more shards - but not an option to create a new empty shard.

The motivation in dynamic shards instead if dynamic indices - is that ranking between documents in the same index is much more accurate than ranking documents between different indices (distributed TF/IDF).

---

<div class="post-metadata">

### Author: ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)
#### Post date: [June 10, 2019, 1:28pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801/2 "2019-06-10T13:28:53Z")

</div>

Check out the [[https://www.elastic.co/guide/en/elasticsearch/reference/7.1/indices-rollover-index.html](https://www.elastic.co/guide/en/elasticsearch/reference/7.1/indices-rollover-index.html)](rollover index API)

---

<div class="post-metadata">

### Author: ![panda2004](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/panda2004/32/19473_2.png) [@panda2004](https://discuss.elastic.co/u/panda2004)
#### Post date: [June 10, 2019, 1:49pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801/3 "2019-06-10T13:49:29Z")

</div>

Thanks for your response, but rollover API allows creating new indices dynamically (and exposing them with an appropriate alias). It doesn't change any of the shards of the current indices.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [June 10, 2019, 2:28pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801/4 "2019-06-10T14:28:02Z")

</div>

There is no way to dynamically create new shards apart from splitting the index. Using time-based indices is the normal way of getting around this.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 8, 2019, 2:28pm UTC](https://discuss.elastic.co/t/dynamic-shards-incremental-resharding/184801/5 "2019-07-08T14:28:04Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
