# Dumping data from 32bit to 64bit
**URL:** https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280
**Category:** Elasticsearch
**Created:** [April 10, 2012, 10:30am UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280 "2012-04-10T10:30:48Z")
**Posts on this page:** 11
**Page:** 1
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 10, 2012, 10:30am UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/1 "2012-04-10T10:30:48Z")
Hi folks. I'm using Elasticsearch 0.18.7 as backend for Logstash and I've
never had to do any administration before, so I'm quite a new user of this
software.
Problem arose because we're moving any service of ours form 32bit to 64bit
architecture, and I hoped to move Elasticsearch as well just moving the
data around. Problem is that I wasn't able to get Elasticsearch with old
data to work in that way and so our collection of Logstash data is now
"forked" between the new set on the 64bit box, and the old data that we'd
like to get back into the new instance. Yeah, I know it's quite messy...
Any chance this can be accomplished? Thanks for your time
---
### Author:  [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [April 11, 2012, 9:45am UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/2 "2012-04-11T09:45:45Z")
You mean you now span a cluster between 32 and 64 bit machines? That won't
be a problem.
On Tue, Apr 10, 2012 at 1:30 PM, Alexander Fortin \<
[alexander.fortin@gmail.com](mailto:alexander.fortin@gmail.com)\> wrote:
> Hi folks. I'm using Elasticsearch 0.18.7 as backend for Logstash and I've
> never had to do any administration before, so I'm quite a new user of this
> software.
>
> Problem arose because we're moving any service of ours form 32bit to 64bit
> architecture, and I hoped to move Elasticsearch as well just moving the
> data around. Problem is that I wasn't able to get Elasticsearch with old
> data to work in that way and so our collection of Logstash data is now
> "forked" between the new set on the 64bit box, and the old data that we'd
> like to get back into the new instance. Yeah, I know it's quite messy...
>
> Any chance this can be accomplished? Thanks for your time
---
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 11, 2012, 12:50pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/3 "2012-04-11T12:50:05Z")
On 4/11/12 11:45 AM, Shay Banon wrote:
> You mean you now span a cluster between 32 and 64 bit machines? That
> won't be a problem.
Not exactly. ES on the 32bit machine now is not used and I'd like to get
data stored there to the new 64bit machine. In the end there will be
just one ES running on 64, hopefully with old data too.
--
Alexander Fortin
> **[Alexander Fortin on about.me](https://about.me/alexanderfortin)**
>
> I am a software engineer in Berlin, Germany. Read my blog.
---
### Author:  [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [April 11, 2012, 6:43pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/4 "2012-04-11T18:43:02Z")
You have several options. The first is simply copying the data directory
from the 32 bit node to the new node, and then shutdown the old node and
start the new node. The second is to do live migration. For this, you can
start the new 64 node and have it join the cluster with the 32 bit node,
onces it has joined the cluster (you can configure the new node with
unicast discovery pointing to the 32 and 64 bit nodes), you have two
options:
1. If you already have number\_of\_replicas set to 1, then you replicas will
be allocated on the new 64bit node. Once the health is green (replicas are
allocated), then you can shutdown the old node and set the number of
replicas to 0. If you initially started with 0 replicas, then you can use
the indices update settings API to increase it to 1 so they will be
replicated on the new node.
2. Once hte cluster is formed, you can issue a cluster update settings API
and decommission the 32 bit node using cluster exclude allocation filtering
(you can do that based on IP, for example:
curl -XPUT localhost:9200/\_cluster/\_settings -d '{
"transient" : {
"cluster.routing.allocation.exclude.\_ip" : "10.0.0.1"
}
}'
And then, wait for green status to have all teh shards migrate to the new
node, and then shutdown the node.
On Wed, Apr 11, 2012 at 3:50 PM, Alexander Fortin \<
[alexander.fortin@gmail.com](mailto:alexander.fortin@gmail.com)\> wrote:
> On 4/11/12 11:45 AM, Shay Banon wrote:
>
> > You mean you now span a cluster between 32 and 64 bit machines? That
> > won't be a problem.
>
> Not exactly. ES on the 32bit machine now is not used and I'd like to get
> data stored there to the new 64bit machine. In the end there will be
> just one ES running on 64, hopefully with old data too.
>
> --
> Alexander Fortin
> [Alexander Fortin - Berlin, Germany | about.me](http://about.me/alexanderfortin/)
---
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 12, 2012, 4:02pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/5 "2012-04-12T16:02:01Z")
On 4/11/12 8:43 PM, Shay Banon wrote:
> You have several options. The first is simply copying the data directory
> from the 32 bit node to the new node, and then shutdown the old node and
> start the new node. The second is to do live migration. For this, you
> can start the new 64 node and have it join the cluster with the 32 bit
> node, onces it has joined the cluster (you can configure the new node
> with unicast discovery pointing to the 32 and 64 bit nodes), you have
> two options:
Hi Shay, thank you very much for your support so far! First I'll try the
first way that seems the most straightforward (I can afford a little of
downtime). I'm just puzzled with one thing: what if I want to "merge"
indices still on the old machine into the new one keeping the new data
collected on the new box there? If I just copy the data dir I guess it
will overwrite the new collected data, right?
--
Alexander Fortin
> **[Alexander Fortin on about.me](https://about.me/alexanderfortin)**
>
> I am a software engineer in Berlin, Germany. Read my blog.
---
### Author:  [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [April 13, 2012, 12:26pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/6 "2012-04-13T12:26:53Z")
Yes, it will overwrite it, if you want to merge it, you need to reindex the
old data into the old data. Another option is to simply copy the daily
indices from the old one to the new cluster, since logstash by default
rollover by day.
On Thu, Apr 12, 2012 at 7:02 PM, Alexander Fortin \<
[alexander.fortin@gmail.com](mailto:alexander.fortin@gmail.com)\> wrote:
> On 4/11/12 8:43 PM, Shay Banon wrote:
>
> > You have several options. The first is simply copying the data directory
> > from the 32 bit node to the new node, and then shutdown the old node and
> > start the new node. The second is to do live migration. For this, you
> > can start the new 64 node and have it join the cluster with the 32 bit
> > node, onces it has joined the cluster (you can configure the new node
> > with unicast discovery pointing to the 32 and 64 bit nodes), you have
> > two options:
>
> Hi Shay, thank you very much for your support so far! First I'll try the
> first way that seems the most straightforward (I can afford a little of
> downtime). I'm just puzzled with one thing: what if I want to "merge"
> indices still on the old machine into the new one keeping the new data
> collected on the new box there? If I just copy the data dir I guess it
> will overwrite the new collected data, right?
>
> --
> Alexander Fortin
> [Alexander Fortin - Berlin, Germany | about.me](http://about.me/alexanderfortin/)
---
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 15, 2012, 12:56pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/7 "2012-04-15T12:56:47Z")
On 4/13/12 2:26 PM, Shay Banon wrote:
> Yes, it will overwrite it, if you want to merge it, you need to reindex
> the old data into the old data.
> ^^^
> I guess you meant into the new data 😉
> Another option is to simply copy the
> daily indices from the old one to the new cluster, since logstash by
> default rollover by day.
Hum, actually that was the first thing I tried but didn't seem to work
to me, I'll give it another try maybe I missed something in the process.
--
Alexander Fortin
> **[Alexander Fortin on about.me](https://about.me/alexanderfortin)**
>
> I am a software engineer in Berlin, Germany. Read my blog.
---
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 15, 2012, 2:17pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/8 "2012-04-15T14:17:54Z")
On 4/15/12 2:56 PM, Alexander Fortin wrote:
> Hum, actually that was the first thing I tried but didn't seem to work
> to me, I'll give it another try maybe I missed something in the process.
Actually, just copying across the indices, something weird happens:
seems that ES removes any index that has been copied:
> **[\[root @ amitest indices \] # lslogstash-2012.01.25 logstash-2012.02.11 logst...](https://pastebin.com/hJVKkbgW)**
>
> Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.
--
Alexander Fortin
> **[Alexander Fortin on about.me](https://about.me/alexanderfortin)**
>
> I am a software engineer in Berlin, Germany. Read my blog.
---
### Author:  [@Alexander\_Fortin](https://discuss.elastic.co/u/Alexander_Fortin)
#### Post date: [April 18, 2012, 9:54am UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/9 "2012-04-18T09:54:53Z")
On 4/15/12 4:17 PM, Alexander Fortin wrote:
> On 4/15/12 2:56 PM, Alexander Fortin wrote:
>
> > > Hum, actually that was the first thing I tried but didn't seem to work
> > > to me, I'll give it another try maybe I missed something in the process.
> > > Actually, just copying across the indices, something weird happens:
> > > seems that ES removes any index that has been copied:
> > > [[root @ amitest indices] # lslogstash-2012.01.25 logstash-2012.02.11 logst - Pastebin.com](http://pastebin.com/hJVKkbgW)
A small update: I'm trying the "set up a cluster" suggested way, but
seems that using v0.18.7, even adding the two nodes to the same cluster
makes new indices disappear from the new (64bit) box.
--
Alexander Fortin
> **[Alexander Fortin on about.me](https://about.me/alexanderfortin)**
>
> I am a software engineer in Berlin, Germany. Read my blog.
---
### Author:  [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [April 19, 2012, 2:35pm UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/10 "2012-04-19T14:35:28Z")
You need to have 0.19 for that.
On Wed, Apr 18, 2012 at 12:54 PM, Alexander Fortin \<
[alexander.fortin@gmail.com](mailto:alexander.fortin@gmail.com)\> wrote:
> On 4/15/12 4:17 PM, Alexander Fortin wrote:
>
> > On 4/15/12 2:56 PM, Alexander Fortin wrote:
> >
> > > > Hum, actually that was the first thing I tried but didn't seem to work
> > > > to me, I'll give it another try maybe I missed something in the
> > > > process.
> > > > Actually, just copying across the indices, something weird happens:
> > > > seems that ES removes any index that has been copied:
> > > > [[root @ amitest indices] # lslogstash-2012.01.25 logstash-2012.02.11 logst - Pastebin.com](http://pastebin.com/hJVKkbgW)
>
> A small update: I'm trying the "set up a cluster" suggested way, but
> seems that using v0.18.7, even adding the two nodes to the same cluster
> makes new indices disappear from the new (64bit) box.
>
> --
> Alexander Fortin
> [Alexander Fortin - Berlin, Germany | about.me](http://about.me/alexanderfortin/)
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 3:31am UTC](https://discuss.elastic.co/t/dumping-data-from-32bit-to-64bit/7280/11 "2017-07-06T03:31:56Z")