# \_count differes (same index different number of shards) **URL:** \ **Category:** Elasticsearch\ **Created:** [January 23, 2015, 2:22am UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792 "2015-01-23T02:22:04Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Daniel\_Gligorov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/daniel_gligorov/32/872_2.png) [@Daniel\_Gligorov](https://discuss.elastic.co/u/Daniel_Gligorov)\ **Post date:** [January 23, 2015, 2:22am UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792/1 "2015-01-23T02:22:04Z")
Hi, Anybody knows how different number of primary shards can affect number of docs (\_count) in same index? I mean I have read-only index OLD, did a snap (ES 1.2) of it and restored it as NEW. Both have same number shards and docs. Then I'm restoring another index NEW\_10, with less primary shards and I'm getting less documents count in it? Doesn't matter how many tried I retested snap and restore, if I don't edit number of shards I end with good counter, so wonder what messes my case [:~] curl localhost:9200/\_cat/indices/OLD,NEW,NEW\_10?v health index pri rep docs.count docs.deleted store.size pri.store.size green OLD 20 2 1333718 78639 15.7gb 5.2gb green NEW 20 1 1333480 78624 10.5gb 5.2gb green NEW\_10 10 1 666064 42696 5.2gb 2.6gb Tried simple math, (docs.count - docs.deleted) / pri, but not getting same result Thank you, -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/7d9512d7-ce4f-4a36-a0ba-bfc88a520e03%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7d9512d7-ce4f-4a36-a0ba-bfc88a520e03%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Daniel\_Gligorov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/daniel_gligorov/32/872_2.png) [@Daniel\_Gligorov](https://discuss.elastic.co/u/Daniel_Gligorov)\ **Post date:** [January 23, 2015, 2:23am UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792/2 "2015-01-23T02:23:52Z")
...some more clarification NEW and NEW\_10 are restored from the same snap taken from OLD. What differs is before restoring NEW\_10, I'm editing manualy number of shards in the mapping in the snap (hdfs\_repository plugin) On Thursday, January 22, 2015 at 6:22:04 PM UTC-8, Daniel Gligorov wrote: > Hi, > > Anybody knows how different number of primary shards can affect number of > docs (\_count) in same index? > > I mean I have read-only index OLD, did a snap (ES 1.2) of it and restored > it as NEW. Both have same number shards and docs. > Then I'm restoring another index NEW\_10, with less primary shards and I'm > getting less documents count in it? > Doesn't matter how many tried I retested snap and restore, if I don't edit > number of shards I end with good counter, so wonder what messes my case > > [:~] curl localhost:9200/\_cat/indices/OLD,NEW,NEW\_10?v > health index pri rep docs.count docs.deleted store.size > pri.store.size > green OLD 20 2 1333718 78639 15.7gb > 5.2gb > green NEW 20 1 1333480 78624 10.5gb 5.2gb > green NEW\_10 10 1 666064 42696 5.2gb 2.6gb > > Tried simple math, (docs.count - docs.deleted) / pri, but not getting same > result > > Thank you, -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [January 23, 2015, 9:34am UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792/3 "2015-01-23T09:34:12Z")
Something I don't get. You are changing the number of shards of an index? This is something you should not be able to do IMHO. You can not restore the full backup in less shards. That's probably the reason you are seeing less docs in your new index because you restored only half of shards with what I would call somehow a "hack". David > Le 23 janv. 2015 à 03:23, Daniel Gligorov [gligorov.daniel@gmail.com](mailto:gligorov.daniel@gmail.com) a écrit : > > ...some more clarification NEW and NEW\_10 are restored from the same snap taken from OLD. > What differs is before restoring NEW\_10, I'm editing manualy number of shards in the mapping in the snap (hdfs\_repository plugin) > > > On Thursday, January 22, 2015 at 6:22:04 PM UTC-8, Daniel Gligorov wrote: > > Hi, > > > > Anybody knows how different number of primary shards can affect number of docs (\_count) in same index? > > > > I mean I have read-only index OLD, did a snap (ES 1.2) of it and restored it as NEW. Both have same number shards and docs. > > Then I'm restoring another index NEW\_10, with less primary shards and I'm getting less documents count in it? > > Doesn't matter how many tried I retested snap and restore, if I don't edit number of shards I end with good counter, so wonder what messes my case > > > > [:~] curl localhost:9200/\_cat/indices/OLD,NEW,NEW\_10?v > > health index pri rep docs.count docs.deleted store.size pri.store.size > > green OLD 20 2 1333718 78639 15.7gb 5.2gb > > green NEW 20 1 1333480 78624 10.5gb 5.2gb > > green NEW\_10 10 1 666064 42696 5.2gb 2.6gb > > > > Tried simple math, (docs.count - docs.deleted) / pri, but not getting same result > > > > Thank you, > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/70546D5D-2BFA-4405-8155-AA85515F7B3C%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/70546D5D-2BFA-4405-8155-AA85515F7B3C%40pilato.fr). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Daniel\_Gligorov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/daniel_gligorov/32/872_2.png) [@Daniel\_Gligorov](https://discuss.elastic.co/u/Daniel_Gligorov)\ **Post date:** [January 23, 2015, 6:58pm UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792/4 "2015-01-23T18:58:22Z")
Yup, that's what I meant. I was editing number of shards in the backup. Thought might work that way, data size to end up same, just in less shards. Thanks for your opinion. I need to edit number of shards, but they are not editable. Re-indexing will take long (3 days). So looking for a solution how to end up with edited shards number by backing up the old and restoring in modified one. Tried [GitHub - mallocator/Elasticsearch-Exporter: A small script to export data from one Elasticsearch cluster into another.](https://github.com/mallocator/Elasticsearch-Exporter) but that one takes long time too (1 day). The snap and restore functionality does it in 1h. Have 40mil docs, 100G. On Friday, January 23, 2015 at 1:34:21 AM UTC-8, David Pilato wrote: > Something I don't get. You are changing the number of shards of an index? > This is something you should not be able to do IMHO. > You can not restore the full backup in less shards. > > That's probably the reason you are seeing less docs in your new index > because you restored only half of shards with what I would call somehow a > "hack". > > David > > Le 23 janv. 2015 à 03:23, Daniel Gligorov \<[gligoro...@gmail.com](mailto:gligoro...@gmail.com) > \\> a écrit : > > ...some more clarification NEW and NEW\_10 are restored from the same snap > taken from OLD. > What differs is before restoring NEW\_10, I'm editing manualy number of > shards in the mapping in the snap (hdfs\_repository plugin) > > On Thursday, January 22, 2015 at 6:22:04 PM UTC-8, Daniel Gligorov wrote: > > > Hi, > > > > Anybody knows how different number of primary shards can affect number of > > docs (\_count) in same index? > > > > I mean I have read-only index OLD, did a snap (ES 1.2) of it and restored > > it as NEW. Both have same number shards and docs. > > Then I'm restoring another index NEW\_10, with less primary shards and I'm > > getting less documents count in it? > > Doesn't matter how many tried I retested snap and restore, if I don't > > edit number of shards I end with good counter, so wonder what messes my case > > > > [:~] curl localhost:9200/\_cat/indices/OLD,NEW,NEW\_10?v > > health index pri rep docs.count docs.deleted store.size > > pri.store.size > > green OLD 20 2 1333718 78639 15.7gb > > 5.2gb > > green NEW 20 1 1333480 78624 10.5gb > > 5.2gb > > green NEW\_10 10 1 666064 42696 5.2gb 2.6gb > > > > Tried simple math, (docs.count - docs.deleted) / pri, but not getting > > same result > > > > Thank you, > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/fa9d4c35-6a3a-4a59-b7c9-9770eea454fe%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ffc17949-bc55-4232-a9a4-794ad5ab681c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ffc17949-bc55-4232-a9a4-794ad5ab681c%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:36am UTC](https://discuss.elastic.co/t/-count-differes-same-index-different-number-of-shards/21792/5 "2017-07-06T00:36:58Z")