# Shard allocation with Hot warm architecture and Vertical scaling?

**URL:** https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882
**Category:** Elasticsearch
**Created:** [May 24, 2016, 8:08pm UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882 "2016-05-24T20:08:17Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![anhlqn](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/anhlqn/32/5454_2.png) [@anhlqn](https://discuss.elastic.co/u/anhlqn)
#### Post date: [May 24, 2016, 8:08pm UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882/1 "2016-05-24T20:08:17Z")

</div>

Hi All,

Just curious how do you route shards from hot to warm nodes and prevent same shard allocation on a physical server in a Vertical scaling model where each physical servers

- 2 or more hot ES nodes with data on SSD
- 2 or more warm ES nodes with data on HDD

It's a combination of [https://www.elastic.co/blog/hot-warm-architecture](https://www.elastic.co/blog/hot-warm-architecture) and [https://www.elastic.co/elasticon/conf/2016/sf/scaling-elasticsearch-at-netsuite-good-bad-and-ugly](https://www.elastic.co/elasticon/conf/2016/sf/scaling-elasticsearch-at-netsuite-good-bad-and-ugly)

I've used `cluster.routing.allocation.same_shard.host` which worked for some indexes but failed for others because shards on hot ES nodes refused to move to warm ES nodes on the same physical server because they think they are on the same physical server (which is actually true). However, what I want to prevent is that same shards (primary and replica) should not allocate on hot nodes or on warm nodes on the same physical server, yet allow shards to move from hot to warm as if they are on a separate physical server.

I believe [https://www.elastic.co/guide/en/elasticsearch/reference/2.3/allocation-awareness.html](https://www.elastic.co/guide/en/elasticsearch/reference/2.3/allocation-awareness.html) is the solution for such deployment, but would appreciate more inputs from the community.

Thanks

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 24, 2016, 8:50pm UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882/2 "2016-05-24T20:50:32Z")

</div>

[https://www.elastic.co/blog/hot-warm-architecture](https://www.elastic.co/blog/hot-warm-architecture) is the best option (which is what the second link also uses).

`cluster.routing.allocation.same_shard.host` is for when you are running multiple nodes per host, it's not for hot/warm.

---

<div class="post-metadata">

### Author: ![anhlqn](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/anhlqn/32/5454_2.png) [@anhlqn](https://discuss.elastic.co/u/anhlqn)
#### Post date: [May 25, 2016, 3:41am UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882/3 "2016-05-25T03:41:36Z")

</div>

Since I have 2 physical servers, each with 48 core CPU, 256 GB RAM, 2x SSD 1 TB, 24 TB HDD, I run hot/warm + vertical scaling model with hot indexes on SSD and warm indexes on HDD. In that way, CPU and RAM won't be wasted.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 25, 2016, 5:36am UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882/4 "2016-05-25T05:36:05Z")

</div>

Ahh ok.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 5, 2017, 10:49pm UTC](https://discuss.elastic.co/t/shard-allocation-with-hot-warm-architecture-and-vertical-scaling/50882/5 "2017-07-05T22:49:15Z")

</div>


