# How to achieve CCR for more than 20 indices at once without snapshot

**URL:** <https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404>\
**Category:** Elasticsearch\
**Tags:** ccr-cross-cluster-replication\
**Created:** [June 9, 2021, 8:49am UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404 "2021-06-09T08:49:08Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Thesupersoftwareguy](https://avatars.discourse-cdn.com/v4/letter/t/e495f1/32.png) [@Thesupersoftwareguy](https://discuss.elastic.co/u/Thesupersoftwareguy)\
**Post date:** [June 9, 2021, 8:49am UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/1 "2021-06-09T08:49:09Z")

</div>

Hello,

I have multiple indices already created in cluster A and I want them to be replicated to cluster B , is there a way to create those many follower indices without manual effort as it will increase operational load and snapshot might not help as these indices keep on getting new updates. Kindly request you to help.

Note : if I use kibana console or curl it would take a lot of time to replicate one by one and auto follow pattern was not enabled before. I am new to elastic search

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 3, 2021, 7:41pm UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/2 "2021-07-03T19:41:26Z")

</div>

This is exactly the problem the [cross-cluster replication](https://www.elastic.co/guide/en/elasticsearch/reference/7.13/xpack-ccr.html) was designed to solve.

---

<div class="post-metadata">

**Author:** ![Thesupersoftwareguy](https://avatars.discourse-cdn.com/v4/letter/t/e495f1/32.png) [@Thesupersoftwareguy](https://discuss.elastic.co/u/Thesupersoftwareguy)\
**Post date:** [July 5, 2021, 4:45am UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/3 "2021-07-05T04:45:50Z")

</div>

Well, the challenge here is there are few indices with unassigned shards during the CCR , I have tried to a reroute which failed , the minimum master node is set to 2 (I have 3 nodes in the CCR cluster , the same in remote as well ). The shards some reason do not get assigned, I have tried everything possible, even ran through multiple solutions you have suggested on other blogs, still does not seem to work. The index size for instance is 40gb ,

1- I have noticed the huge size indices (above 2gb) indices (followers in CCR) are always in pause state and when I try to resume , I get an error like the primary shared of a follower index .. from ccr is unassigned , reason = manual allocation . Ml.machine\_mem = .. , xpack.installed = true , transform.node =true , ml.max\_open\_jobs = 20.) Nested : Indexshardrecoveryexception [failed recovery]

2- when I try reroute with Post like :  
Post /\_cluster/reroute  
Commands: allocate : Index: shard : node: allow primary:  
(Specified all values , could not copy paste exact command and mentioned all 3 nodes in node field ) , I get an error : type : named object not found exception resaon : unknown filed allocate. Though the index is in red state

3- tried a full restart of the cluster as well, the cluster.routing allocation enable is also set to all

1. For some reason the replication happens but few huge size indices are always in pause state in follower stats

Note : the remote's indices are all I green, only in the CCR cluster this happens that I am left with unassigned primaries

---

<div class="post-metadata">

**Author:** ![Thesupersoftwareguy](https://avatars.discourse-cdn.com/v4/letter/t/e495f1/32.png) [@Thesupersoftwareguy](https://discuss.elastic.co/u/Thesupersoftwareguy)\
**Post date:** [August 1, 2021, 2:05pm UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/4 "2021-08-01T14:05:15Z")

</div>

Hello , requesting your advice on the above

---

<div class="post-metadata">

**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\
**Post date:** [August 1, 2021, 5:18pm UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/5 "2021-08-01T17:18:34Z")

</div>

It's impossible to offer advice on such a small amount of vague information, sorry. You haven't shared any actual logs or errors or really anything that might help. You haven't even said what version you're using. CCR will definitely normally replicate a 40GB index onto the remote cluster without problems; replicating data onto a remote cluster is exactly what it's designed to do.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 29, 2021, 5:19pm UTC](https://discuss.elastic.co/t/how-to-achieve-ccr-for-more-than-20-indices-at-once-without-snapshot/275404/6 "2021-08-29T17:19:03Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
