# Real time Migration of Tenant/Customer from One Cluster to Another Cluster **URL:** \ **Category:** Elasticsearch\ **Created:** [November 20, 2013, 10:16pm UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504 "2013-11-20T22:16:56Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![pranav\_amin](https://avatars.discourse-cdn.com/v4/letter/p/a183cd/32.png) [@pranav\_amin](https://discuss.elastic.co/u/pranav_amin)\ **Post date:** [November 20, 2013, 10:16pm UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504/1 "2013-11-20T22:16:56Z")
Hi, We are having multiple tenants in one cluster. And since the volume of one tenant has increased, we are planning to move that Tenant into different Cluster. The only challenge is - it needs to be done in Real time without Customer Impact. Does anyone know if Elasticsearch has some functionality to do this kind of migration of Tenant data (from one cluster to another) in Real time? Or any other Ideas? Thanks for support. Thanks Pranav. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 20, 2013, 10:19pm UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504/2 "2013-11-20T22:19:44Z")
You could use logstash's elasticsearch in/outputs, or this [GitHub - elastic/stream2es: Stream data into ES (Wikipedia, Twitter, stdin, or other ESes)](https://github.com/elasticsearch/stream2es). V1.0 of elasticsearch will contain snapshot/backup functionality that will eventually allow this. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 21 November 2013 09:16, pranav amin [parulpatel25@gmail.com](mailto:parulpatel25@gmail.com) wrote: > Hi, > > We are having multiple tenants in one cluster. And since the volume of one > tenant has increased, we are planning to move that Tenant into different > Cluster. > The only challenge is - it needs to be done in Real time without Customer > Impact. > > Does anyone know if Elasticsearch has some functionality to do this kind > of migration of Tenant data (from one cluster to another) in Real time? > Or any other Ideas? > > Thanks for support. > > Thanks > Pranav. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![pranav\_amin](https://avatars.discourse-cdn.com/v4/letter/p/a183cd/32.png) [@pranav\_amin](https://discuss.elastic.co/u/pranav_amin)\ **Post date:** [November 21, 2013, 8:22pm UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504/3 "2013-11-21T20:22:55Z")
Hi Mark, Thanks for responding. Just want to make sure can i use them in real time so that the customer doesn't any impact as the data is moved to other cluster? So basically A customer has 10 Million records, and it is a LIVE environment - how do i start the migration? I mean do i just start the [snapshot/restore or logstash or github link] and it will make sure whatever data is there in Old Cluster along with the Ongoing changes move to New cluster? Thanks Pranav. On Wed, Nov 20, 2013 at 5:19 PM, Mark Walkom [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)wrote: > You could use logstash's elasticsearch in/outputs, or this > [GitHub - elastic/stream2es: Stream data into ES (Wikipedia, Twitter, stdin, or other ESes)](https://github.com/elasticsearch/stream2es). > > V1.0 of elasticsearch will contain snapshot/backup functionality that will > eventually allow this. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > On 21 November 2013 09:16, pranav amin [parulpatel25@gmail.com](mailto:parulpatel25@gmail.com) wrote: > > > Hi, > > > > We are having multiple tenants in one cluster. And since the volume of > > one tenant has increased, we are planning to move that Tenant into > > different Cluster. > > The only challenge is - it needs to be done in Real time without > > Customer Impact. > > > > Does anyone know if Elasticsearch has some functionality to do this kind > > of migration of Tenant data (from one cluster to another) in Real time? > > Or any other Ideas? > > > > Thanks for support. > > > > Thanks > > Pranav. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/yR\_od8zPL-I/unsubscribe](https://groups.google.com/d/topic/elasticsearch/yR_od8zPL-I/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 21, 2013, 9:38pm UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504/4 "2013-11-21T21:38:01Z")
I can't comment on that as I haven't yet had the chance to use stream2es (but will soon). You might want to test the process first to make sure it does what you want. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 22 November 2013 07:22, parul patel [parulpatel25@gmail.com](mailto:parulpatel25@gmail.com) wrote: > Hi Mark, > > Thanks for responding. > > Just want to make sure can i use them in real time so that the customer > doesn't any impact as the data is moved to other cluster? > So basically A customer has 10 Million records, and it is a LIVE > environment - how do i start the migration? > I mean do i just start the [snapshot/restore or logstash or github link] > and it will make sure whatever data is there in Old Cluster along with the > Ongoing changes move to New cluster? > > Thanks > Pranav. > > On Wed, Nov 20, 2013 at 5:19 PM, Mark Walkom [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)wrote: > > > You could use logstash's elasticsearch in/outputs, or this > > [GitHub - elastic/stream2es: Stream data into ES (Wikipedia, Twitter, stdin, or other ESes)](https://github.com/elasticsearch/stream2es). > > > > V1.0 of elasticsearch will contain snapshot/backup functionality that > > will eventually allow this. > > > > Regards, > > Mark Walkom > > > > Infrastructure Engineer > > Campaign Monitor > > email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com) > > > > On 21 November 2013 09:16, pranav amin [parulpatel25@gmail.com](mailto:parulpatel25@gmail.com) wrote: > > > > > Hi, > > > > > > We are having multiple tenants in one cluster. And since the volume of > > > one tenant has increased, we are planning to move that Tenant into > > > different Cluster. > > > The only challenge is - it needs to be done in Real time without > > > Customer Impact. > > > > > > Does anyone know if Elasticsearch has some functionality to do this kind > > > of migration of Tenant data (from one cluster to another) in Real time? > > > Or any other Ideas? > > > > > > Thanks for support. > > > > > > Thanks > > > Pranav. > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > > > -- > > You received this message because you are subscribed to a topic in the > > Google Groups "elasticsearch" group. > > To unsubscribe from this topic, visit > > [https://groups.google.com/d/topic/elasticsearch/yR\_od8zPL-I/unsubscribe](https://groups.google.com/d/topic/elasticsearch/yR_od8zPL-I/unsubscribe). > > To unsubscribe from this group and all its topics, send an email to > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:05am UTC](https://discuss.elastic.co/t/real-time-migration-of-tenant-customer-from-one-cluster-to-another-cluster/14504/5 "2017-07-06T02:05:35Z")
Closed on July 6, 2017, 2:05am UTC