Data migration from solr to elasticsearch

Bharvi_Dixit_2 · November 30, 2013, 5:54pm

Hi all,

I am using solr-river plugin for migrating all the data from solr3.6 to
elastic search.
My solr instance contains 5 cores and have to migrate all the cores into
correspondinx indexes of elastic search.
I have migrated one core into elastic search using solr-river but the
problem is:
During migration elastic search creates one index with the name "solr" and
type "import"

I want to rename this index to some other name which i am unable to do.
I have know clue how can i migrate my all solr cores into different
indexes into elastic search.

Please help me in these issue..

Thanks in advance.
Bharvi Dixit

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2415a16d-2156-434b-8915-39afbe156821%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

radu_gheorghe · December 2, 2013, 9:58am

Hi,

I've never used this plugin, but looking at the
READMEhttps://github.com/javanna/elasticsearch-river-solr/blob/master/README.mdit
seems that you have an "index" option that lets you specify where to
index your data:

"index" : {
    "index" : "solr",
    "type" : "import",
    "bulk_size" : 100,
    "max_concurrent_bulk" : 10,
    "mapping" : "",
    "settings": ""
}

If you need to take one core at a time and put it in different places, I
guess you can use multiple rivers with multiple configurations. For example:

"url" : "http://localhost:8983/solr/core1/",

for one river and

"url" : "http://localhost:8983/solr/core2",

for another and so on.

Best regards,
Radu

On Sat, Nov 30, 2013 at 7:54 PM, Bharvi Dixit bharvidixit@gmail.com wrote:

Hi all,

I am using solr-river plugin for migrating all the data from solr3.6 to
Elasticsearch.
My solr instance contains 5 cores and have to migrate all the cores into
correspondinx indexes of Elasticsearch.
I have migrated one core into Elasticsearch using solr-river but the
problem is:
During migration Elasticsearch creates one index with the name "solr" and
type "import"

I want to rename this index to some other name which i am unable to do.

I have know clue how can i migrate my all solr cores into different
indexes into Elasticsearch.

Please help me in these issue..

Thanks in advance.
Bharvi Dixit

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2415a16d-2156-434b-8915-39afbe156821%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAHXA0_2%3Da8wZGVmopa9sQnuGV4BgTLdxLgnjNSUbKoXxQ6sj7Q%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

Bharvi_Dixit_2 · December 2, 2013, 4:47pm

Yes Mr. Radu Gheorghe, you are absolutely correct. I had a chat with Mr.
Luca cavanna too and he pointed out the same thing.
There is one more issue i am facing and that is if i have to manipulate
some fields while migration (Some fields needs to be merged and some has to
be deleted) then how can i do that.
I know by specifying fields name which needs to be fetched in fl parameter
but i need to merge the value of some fields into a single one during
migration. If possible then reply how can i achieve that.

Thanks for your time and valuable comment.

Regards,

Bharvi Dixit

On Monday, 2 December 2013 15:28:49 UTC+5:30, Radu Gheorghe wrote:

Hi,

I've never used this plugin, but looking at the READMEhttps://github.com/javanna/elasticsearch-river-solr/blob/master/README.mdit seems that you have an "index" option that lets you specify where to
index your data:
"index" : {
    "index" : "solr",
    "type" : "import",
    "bulk_size" : 100,
    "max_concurrent_bulk" : 10,
    "mapping" : "",
    "settings": ""
}
If you need to take one core at a time and put it in different places, I
guess you can use multiple rivers with multiple configurations. For example:

"url" : "http://localhost:8983/solr/core1/",

for one river and

"url" : "http://localhost:8983/solr/core2",

for another and so on.

Best regards,
Radu

On Sat, Nov 30, 2013 at 7:54 PM, Bharvi Dixit <bharv...@gmail.com<javascript:>

wrote:

Hi all,

I am using solr-river plugin for migrating all the data from solr3.6 to
Elasticsearch.
My solr instance contains 5 cores and have to migrate all the cores into
correspondinx indexes of Elasticsearch.
I have migrated one core into Elasticsearch using solr-river but the
problem is:
During migration Elasticsearch creates one index with the name "solr"
and type "import"

I want to rename this index to some other name which i am unable to do.

I have know clue how can i migrate my all solr cores into different
indexes into Elasticsearch.

Please help me in these issue..

Thanks in advance.
Bharvi Dixit

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2415a16d-2156-434b-8915-39afbe156821%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/dd49e30d-5c15-4f2e-8096-ba7e1cfb05c2%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

javanna · December 2, 2013, 7:15pm

I think you can achieve that by using scripting, although it might slow
down the import time. Have a look at the README, transform section in the
json, which allows to somehow modify your documents through scripting
before indexing them.

On Monday, December 2, 2013 5:47:15 PM UTC+1, Bharvi Dixit wrote:

Yes Mr. Radu Gheorghe, you are absolutely correct. I had a chat with Mr.
Luca cavanna too and he pointed out the same thing.
There is one more issue i am facing and that is if i have to manipulate
some fields while migration (Some fields needs to be merged and some has to
be deleted) then how can i do that.
I know by specifying fields name which needs to be fetched in fl parameter
but i need to merge the value of some fields into a single one during
migration. If possible then reply how can i achieve that.

Thanks for your time and valuable comment.

Regards,

Bharvi Dixit

On Monday, 2 December 2013 15:28:49 UTC+5:30, Radu Gheorghe wrote:
Hi,

I've never used this plugin, but looking at the READMEhttps://github.com/javanna/elasticsearch-river-solr/blob/master/README.mdit seems that you have an "index" option that lets you specify where to
index your data:
"index" : {
    "index" : "solr",
    "type" : "import",
    "bulk_size" : 100,
    "max_concurrent_bulk" : 10,
    "mapping" : "",
    "settings": ""
}
If you need to take one core at a time and put it in different places, I
guess you can use multiple rivers with multiple configurations. For example:

"url" : "http://localhost:8983/solr/core1/",

for one river and

"url" : "http://localhost:8983/solr/core2",

for another and so on.

Best regards,
Radu

On Sat, Nov 30, 2013 at 7:54 PM, Bharvi Dixit bharv...@gmail.com wrote:

Hi all,

I am using solr-river plugin for migrating all the data from solr3.6 to
Elasticsearch.
My solr instance contains 5 cores and have to migrate all the cores into
correspondinx indexes of Elasticsearch.
I have migrated one core into Elasticsearch using solr-river but the
problem is:
During migration Elasticsearch creates one index with the name "solr"
and type "import"

I want to rename this index to some other name which i am unable to
do.

I have know clue how can i migrate my all solr cores into different
indexes into Elasticsearch.

Please help me in these issue..

Thanks in advance.
Bharvi Dixit

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2415a16d-2156-434b-8915-39afbe156821%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/13a91563-0d70-4fcb-97af-2e990fc61be0%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Sam_Kumar · June 11, 2014, 12:30pm

hi,

Please help me to migrate solr to Elasticsearch in broadleaf ..

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/955c9b61-d563-4182-bb35-883c3631f2dc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Topic		Replies	Views
Migrating SOLR indexes into ElasticSearch Elasticsearch	2	1714	September 19, 2017
Elasticsearch solr river Elasticsearch	5	363	July 6, 2017
Elasticsearch Solr updated river/plugin Elasticsearch	1	375	July 31, 2018
Migration from Solr to ElasticSearch Elasticsearch	6	4374	July 6, 2017
How to migrate lucene index into elasticsearch Elasticsearch	7	5795	July 6, 2017

Data migration from solr to elasticsearch

Related topics