# Feeds/Shard based on machines hardware capacity **URL:** \ **Category:** Elasticsearch\ **Created:** [May 30, 2013, 5:09am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185 "2013-05-30T05:09:53Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![vineeth\_mohan](https://avatars.discourse-cdn.com/v4/letter/v/bc79bd/32.png) [@vineeth\_mohan](https://discuss.elastic.co/u/vineeth_mohan)\ **Post date:** [May 30, 2013, 5:09am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185/1 "2013-05-30T05:09:53Z")
Hi , Is there any provision in elasticsearch where it automatically decides on increasing or decreasing percentage of feed in a particular shard due to its hardware capability. I would love to see a feature where it allocates more feeds to a shard whose machine has bigger capability and lesser feeds whose allocated machines have lesser hardware capability. It would be even great if i can tell manually which all shards should have what percentage of total feeds. Is there any configuration which will help in any of the above. Thanks Vineeth -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [May 30, 2013, 6:55am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185/2 "2013-05-30T06:55:57Z")
Hey, have you taken a look at shard allocation? See [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/index-modules/allocation/) It's not automatic (there is no reliable mechanism deciding for elasticsearch that this node is extraordinary powerful. Judging from its hardware might be a mistake as many other services might run on the node, you have to jump in here) mechanism, but you can do it by grouping nodes for example. --Alex On Thu, May 30, 2013 at 7:09 AM, Vineeth Mohan [vineethmohan@algotree.com](mailto:vineethmohan@algotree.com)wrote: > Hi , > > Is there any provision in elasticsearch where it automatically decides on > increasing or decreasing percentage of feed in a particular shard due to > its hardware capability. > I would love to see a feature where it allocates more feeds to a shard > whose machine has bigger capability and lesser feeds whose allocated > machines have lesser hardware capability. > > It would be even great if i can tell manually which all shards should have > what percentage of total feeds. > Is there any configuration which will help in any of the above. > > Thanks > Vineeth > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![vineeth\_mohan](https://avatars.discourse-cdn.com/v4/letter/v/bc79bd/32.png) [@vineeth\_mohan](https://discuss.elastic.co/u/vineeth_mohan)\ **Post date:** [May 30, 2013, 9:16am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185/3 "2013-05-30T09:16:17Z")
Hello Alex , Using shard allocation , i might be able to move a shard from a week machine to a string machine. But this wont fully exploit the capability of the entire network. What i am looking for is to do the following - Suppose there are 4 shards on 4 different machines. I want ES to put 40% of the total data in shard1 , 10% in shard2 , 30% in shard3 and 20% in shard4. Is this possible in ES ? If not , wont it be a good idea to post a feature requirement based on this. Thanks Vineeth On Thu, May 30, 2013 at 12:25 PM, Alexander Reelsen [alr@spinscale.de](mailto:alr@spinscale.de)wrote: > Hey, > > have you taken a look at shard allocation? > See [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/index-modules/allocation/) > > It's not automatic (there is no reliable mechanism deciding for > elasticsearch that this node is extraordinary powerful. Judging from its > hardware might be a mistake as many other services might run on the node, > you have to jump in here) mechanism, but you can do it by grouping nodes > for example. > > --Alex > > On Thu, May 30, 2013 at 7:09 AM, Vineeth Mohan [vineethmohan@algotree.com](mailto:vineethmohan@algotree.com)wrote: > > > Hi , > > > > Is there any provision in elasticsearch where it automatically decides on > > increasing or decreasing percentage of feed in a particular shard due to > > its hardware capability. > > I would love to see a feature where it allocates more feeds to a shard > > whose machine has bigger capability and lesser feeds whose allocated > > machines have lesser hardware capability. > > > > It would be even great if i can tell manually which all shards should > > have what percentage of total feeds. > > Is there any configuration which will help in any of the above. > > > > Thanks > > > > ``` > > Vineeth > > > > ``` > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 30, 2013, 9:19am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185/4 "2013-05-30T09:19:30Z")
I don't think it's doable easily. I mean that you will need to control that on your end and change a little bit the routing feature. Because, when you want to do a GET, ES is going directly to the right shard using this routing. How to find the relevant shard if it's not based on id or routing key? -- David Pilato | Technical Advocate | [Elasticsearch.com](http://Elasticsearch.com) @dadoonet | @elasticsearchfr | @scrutmydocs Le 30 mai 2013 à 11:16, Vineeth Mohan [vineethmohan@algotree.com](mailto:vineethmohan@algotree.com) a écrit : > Hello Alex , > > Using shard allocation , i might be able to move a shard from a week machine to a string machine. > But this wont fully exploit the capability of the entire network. > > What i am looking for is to do the following - > Suppose there are 4 shards on 4 different machines. I want ES to put 40% of the total data in shard1 , 10% in shard2 , 30% in shard3 and 20% in shard4. > > Is this possible in ES ? > If not , wont it be a good idea to post a feature requirement based on this. > > Thanks > Vineeth > > On Thu, May 30, 2013 at 12:25 PM, Alexander Reelsen [alr@spinscale.de](mailto:alr@spinscale.de) wrote: > Hey, > > have you taken a look at shard allocation? > See [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/index-modules/allocation/) > > It's not automatic (there is no reliable mechanism deciding for elasticsearch that this node is extraordinary powerful. Judging from its hardware might be a mistake as many other services might run on the node, you have to jump in here) mechanism, but you can do it by grouping nodes for example. > > --Alex > > On Thu, May 30, 2013 at 7:09 AM, Vineeth Mohan [vineethmohan@algotree.com](mailto:vineethmohan@algotree.com) wrote: > Hi , > > Is there any provision in elasticsearch where it automatically decides on increasing or decreasing percentage of feed in a particular shard due to its hardware capability. > I would love to see a feature where it allocates more feeds to a shard whose machine has bigger capability and lesser feeds whose allocated machines have lesser hardware capability. > > It would be even great if i can tell manually which all shards should have what percentage of total feeds. > Is there any configuration which will help in any of the above. > > Thanks > > ``` > Vineeth > > ``` > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:33am UTC](https://discuss.elastic.co/t/feeds-shard-based-on-machines-hardware-capacity/12185/5 "2017-07-06T02:33:54Z")
Closed on July 6, 2017, 2:33am UTC