Manually create another warm node


#1

I have an elastic setup with the hot/warm architecture. The issue is that I have replica turned on to 1, but only 1 warm node, so there's no where to replicate to and shards are not being allocated to the warm node. Is there a way to create another warm node within my cluster?


(Jymit Singh Khondhu) #2

When you move an index from a hot to warm could/would you be willing to modify the replica from 1 to 0?
How many hot warm nodes in this cluster at whole?


#3

host1 master_nodes_count=1 hot_nodes_count=1 warm_nodes_count=1

I'd like to keep the replica in tact and just add more nodes if possible, but I suppose I could set the replica to 0 which would allocate the shards if my understanding is correct.


#4

{
"test-empty" : {
"settings" : {
"index" : {
"mapping" : {
"total_fields" : {
"limit" : "4000"
}
},
"refresh_interval" : "30s",
"translog" : {
"flush_threshold_size" : "1G",
"durability" : "async"
},
"provided_name" : "test-empty",
"creation_date" : "1527628269334",
"analysis" : {
"filter" : {
"custom_word_delimiter" : {
"type" : "word_delimiter",
"preserve_original" : "true"
}
},
"analyzer" : {
"custom_standard" : {
"filter" : [
"standard",
"lowercase",
"custom_word_delimiter"
],
"type" : "custom",
"tokenizer" : "jh_cluster_test"
}
}
},
"number_of_replicas" : "0",
"uuid" : "mhxkFqscSMqn107Yhy5K4g",
"version" : {
"created" : "5040099"
},
"codec" : "best_compression",
"routing" : {
"allocation" : {
"require" : {
"box_type" : "hot"
}
}
},
"number_of_shards" : "1",
"merge" : {
"scheduler" : {
"max_thread_count" : "1"
}
}
}
}
},
".kibana" : {
"settings" : {
"index" : {
"creation_date" : "1527628253923",
"number_of_shards" : "1",
"number_of_replicas" : "1",
"uuid" : "rPBY8oNITYSUnOneO4T_Kg",
"version" : {
"created" : "5040099"
},
"provided_name" : ".kibana"
}
}
},
"jhtest2018.05.29" : {
"settings" : {
"index" : {
"mapping" : {
"total_fields" : {
"limit" : "4000"
}
},
"refresh_interval" : "30s",
"translog" : {
"flush_threshold_size" : "1G",
"durability" : "async"
},
"provided_name" : "jhtest-2018.05.29",
"creation_date" : "1527629509719",
"analysis" : {
"filter" : {
"custom_word_delimiter" : {
"type" : "word_delimiter",
"preserve_original" : "true"
}
},
"analyzer" : {
"custom_standard" : {
"filter" : [
"standard",
"lowercase",
"custom_word_delimiter"
],
"type" : "custom",
"tokenizer" : "jh_cluster_test"
}
}
},
"number_of_replicas" : "0",
"uuid" : "22OxIZcJTyKFg-t8yLbtZw",
"version" : {
"created" : "5040099"
},
"codec" : "best_compression",
"routing" : {
"allocation" : {
"require" : {
"box_type" : "hot"
}
}
},
"number_of_shards" : "2",
"merge" : {
"scheduler" : {
"max_thread_count" : "1"
}
}
}
}
},
"index-migrations" : {
"settings" : {
"index" : {
"creation_date" : "1527628511404",
"number_of_shards" : "1",
"number_of_replicas" : "1",
"uuid" : "rRLd-UqRTMm_JhljDqiUrw",
"version" : {
"created" : "5040099"
},
"provided_name" : "index-migrations"
}
}
},
"elastalert_status" : {
"settings" : {
"index" : {
"routing" : {
"allocation" : {
"require" : {
"box_type" : "warm"
}
}
},
"number_of_shards" : "2",
"provided_name" : "elastalert_status",
"creation_date" : "1527627884191",
"number_of_replicas" : "1",
"uuid" : "bvBnBX54T_WutrpJG7f57w",
"version" : {
"created" : "5040099"
}
}
}
}
}


(Jymit Singh Khondhu) #5

What are you looking to achieve with this current hot warm setup?
Does the hot node have faster storage (SSD?) and more CPU comparatively to the warm node?

Going back to the question you asked: Is there a way to create another warm node within my cluster?
Creating a new warm node with node.attr.box_type set to warm and the same cluster name will get you a warm node added to your current setup.


#6

That is correct. I'm just looking to have my most recent data quickly accessible while my older data sits in the warm tier on slower drives.


(system) #7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.