# Integrating MongoDB with Elastic Search

**URL:** <https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808>\
**Category:** Elasticsearch\
**Created:** [November 23, 2012, 9:48pm UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808 "2012-11-23T21:48:07Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sanx\_El\_Santo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sanx_el_santo/32/1990_2.png) [@Sanx\_El\_Santo](https://discuss.elastic.co/u/Sanx_El_Santo)\
**Post date:** [November 23, 2012, 9:48pm UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/1 "2012-11-23T21:48:07Z")

</div>

Greetings to all

I'm trying to integrate MongoDB with elasticsearch

'm using this guide:

> **[A complete guide to Integrating MongoDB with Elastic Search](http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mongodb-with-elastic-search/)**
>
> After almost two weeks and several re-installs and fresh installs, I finally got to integrate mongodb and elastic search. Here is a step by step procedure on how to integrate them. If you follow th…

With following command in my terminal:

curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)' -d '{  
"type": "mongodb",  
"mongodb": {  
"db": "santix",  
"collection": "posts"  
},  
"index": {  
"name": "mongoindex",  
"type": "posts"  
}  
}'

and the output is:

{"error":"MapperParsingException[Failed to parse]; nested:  
JsonParseException[Unexpected end-of-input in field name\n at [Source:  
[B@1bfa1ba1; line: 2, column: 2]]; ","status":400}

and the elasticsearch output is:

[2012-11-23 10:25:12,843][DEBUG][action.index] [Rafferty]  
[\_river][0], node[q2OyKdZaRXGf-SMhPGSrSw], [P], s[STARTED]: Failed to  
execute [index {[\_river][mongodb][\_meta], source[{  
??? "type": "mongodb",  
??? "mongodb": {  
??????? "db": "santix",  
??????? "collection": "posts"  
??? },  
??? "index": {  
??????? "name": "mongoindex",  
??????? "type": "posts"  
??? }  
}]}]  
org.elasticsearch.index.mapper.MapperParsingException: Failed to parse  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
509)  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
438)  
at  
org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:  
308)  
at  
org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:  
202)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction  
$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:  
532)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction  
$AsyncShardOperationAction  
$1.run(TransportShardReplicationOperationAction.java:430)  
at java.util.concurrent.ThreadPoolExecutor  
$Worker.runTask(ThreadPoolExecutor.java:886)  
at java.util.concurrent.ThreadPoolExecutor  
$Worker.run(ThreadPoolExecutor.java:908)  
at java.lang.Thread.run(Thread.java:680)  
Caused by: org.elasticsearch.common.jackson.core.JsonParseException:  
Unexpected end-of-input in field name  
at [Source: [B@1bfa1ba1; line: 2, column: 2]  
at  
org.elasticsearch.common.jackson.core.JsonParser.\_constructError(JsonParser.java:  
1284)  
at  
org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportError(ParserMinimalBase.java:  
588)  
at  
org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportInvalidEOF(ParserMinimalBase.java:  
521)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.addName(UTF8StreamJsonParser.java:  
1817)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_handleUnusualFieldName(UTF8StreamJsonParser.java:  
1597)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_parseFieldName(UTF8StreamJsonParser.java:  
1233)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:  
501)  
at  
org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:  
48)  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
468)  
... 8 more

Can someone please help me and tell me what I'm missing or what I'm  
doing wrong?

Thank you very much for your attention

--

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 23, 2012, 11:46pm UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/2 "2012-11-23T23:46:25Z")

</div>

Sounds like there are some bad chars here.  
Try this:

curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)' -d '{"type": "mongodb","mongodb": {"db": "santix","collection": "posts"},"index": {"name": "mongoindex","type": "posts"}}'

Does it help?

--  
David 😉  
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 23 nov. 2012 à 22:48, Sanx El Santo [hectorgool@gmail.com](mailto:hectorgool@gmail.com) a écrit :

Greetings to all

I'm trying to integrate MongoDB with elasticsearch

'm using this guide:

> **[A complete guide to Integrating MongoDB with Elastic Search](http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mongodb-with-elastic-search/)**
>
> After almost two weeks and several re-installs and fresh installs, I finally got to integrate mongodb and elastic search. Here is a step by step procedure on how to integrate them. If you follow th…

With following command in my terminal:

curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)' -d '{  
"type": "mongodb",  
"mongodb": {  
"db": "santix",  
"collection": "posts"  
},  
"index": {  
"name": "mongoindex",  
"type": "posts"  
}  
}'

and the output is:

{"error":"MapperParsingException[Failed to parse]; nested:  
JsonParseException[Unexpected end-of-input in field name\n at [Source:  
[B@1bfa1ba1; line: 2, column: 2]]; ","status":400}

and the elasticsearch output is:

[2012-11-23 10:25:12,843][DEBUG][action.index] [Rafferty]  
[\_river][0], node[q2OyKdZaRXGf-SMhPGSrSw], [P], s[STARTED]: Failed to  
execute [index {[\_river][mongodb][\_meta], source[{  
??? "type": "mongodb",  
??? "mongodb": {  
??????? "db": "santix",  
??????? "collection": "posts"  
??? },  
??? "index": {  
??????? "name": "mongoindex",  
??????? "type": "posts"  
??? }  
}]}]  
org.elasticsearch.index.mapper.MapperParsingException: Failed to parse  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
509)  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
438)  
at  
org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:  
308)  
at  
org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:  
202)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction  
$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:  
532)  
at  
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction  
$AsyncShardOperationAction  
$1.run(TransportShardReplicationOperationAction.java:430)  
at java.util.concurrent.ThreadPoolExecutor  
$Worker.runTask(ThreadPoolExecutor.java:886)  
at java.util.concurrent.ThreadPoolExecutor  
$Worker.run(ThreadPoolExecutor.java:908)  
at java.lang.Thread.run(Thread.java:680)  
Caused by: org.elasticsearch.common.jackson.core.JsonParseException:  
Unexpected end-of-input in field name  
at [Source: [B@1bfa1ba1; line: 2, column: 2]  
at  
org.elasticsearch.common.jackson.core.JsonParser.\_constructError(JsonParser.java:  
1284)  
at  
org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportError(ParserMinimalBase.java:  
588)  
at  
org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportInvalidEOF(ParserMinimalBase.java:  
521)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.addName(UTF8StreamJsonParser.java:  
1817)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_handleUnusualFieldName(UTF8StreamJsonParser.java:  
1597)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_parseFieldName(UTF8StreamJsonParser.java:  
1233)  
at  
org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:  
501)  
at  
org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:  
48)  
at  
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
468)  
... 8 more

Can someone please help me and tell me what I'm missing or what I'm  
doing wrong?

Thank you very much for your attention

--

--

---

<div class="post-metadata">

**Author:** ![Sanx\_El\_Santo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sanx_el_santo/32/1990_2.png) [@Sanx\_El\_Santo](https://discuss.elastic.co/u/Sanx_El_Santo)\
**Post date:** [November 24, 2012, 3:31pm UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/3 "2012-11-24T15:31:12Z")

</div>

Yessssss

Thank you very much David!!!

On 23 nov, 17:46, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote:

> Sounds like there are some bad chars here.  
> Try this:
> 
> curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta'-d](http://localhost:9200/_river/mongodb/_meta'-d) '{"type": "mongodb","mongodb": {"db": "santix","collection": "posts"},"index": {"name": "mongoindex","type": "posts"}}'
> 
> Does it help?
> 
> --  
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> 
> Le 23 nov. 2012 à 22:48, Sanx El Santo [hectorg...@gmail.com](mailto:hectorg...@gmail.com) a écrit :
> 
> Greetings to all
> 
> I'm trying to integrate MongoDB with elasticsearch
> 
> 'm using this guide:
> 
> [http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mong](http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mong)...
> 
> With following command in my terminal:
> 
> curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta'-d](http://localhost:9200/_river/mongodb/_meta'-d) '{  
> "type": "mongodb",  
> "mongodb": {  
> "db": "santix",  
> "collection": "posts"  
> },  
> "index": {  
> "name": "mongoindex",  
> "type": "posts"  
> }
> 
> }'
> 
> and the output is:
> 
> {"error":"MapperParsingException[Failed to parse]; nested:  
> JsonParseException[Unexpected end-of-input in field name\n at [Source:  
> [B@1bfa1ba1; line: 2, column: 2]]; ","status":400}
> 
> and the elasticsearch output is:
> 
> [2012-11-23 10:25:12,843][DEBUG][action.index] [Rafferty]  
> [\_river][0], node[q2OyKdZaRXGf-SMhPGSrSw], [P], s[STARTED]: Failed to  
> execute [index {[\_river][mongodb][\_meta], source[{  
> ??? "type": "mongodb",  
> ??? "mongodb": {  
> ??????? "db": "santix",  
> ??????? "collection": "posts"  
> ??? },  
> ??? "index": {  
> ??????? "name": "mongoindex",  
> ??????? "type": "posts"  
> ??? }}]}]
> 
> org.elasticsearch.index.mapper.MapperParsingException: Failed to parse  
> at  
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 509)  
> at  
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 438)  
> at  
> org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(Inter nalIndexShard.java:  
> 308)  
> at  
> org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary (TransportIndexAction.java:  
> 202)  
> at  
> org.elasticsearch.action.support.replication.TransportShardReplicationOpera tionAction  
> $AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperat ionAction.java:  
> 532)  
> at  
> org.elasticsearch.action.support.replication.TransportShardReplicationOpera tionAction  
> $AsyncShardOperationAction  
> $1.run(TransportShardReplicationOperationAction.java:430)  
> at java.util.concurrent.ThreadPoolExecutor  
> $Worker.runTask(ThreadPoolExecutor.java:886)  
> at java.util.concurrent.ThreadPoolExecutor  
> $Worker.run(ThreadPoolExecutor.java:908)  
> at java.lang.Thread.run(Thread.java:680)  
> Caused by: org.elasticsearch.common.jackson.core.JsonParseException:  
> Unexpected end-of-input in field name  
> at [Source: [B@1bfa1ba1; line: 2, column: 2]  
> at  
> org.elasticsearch.common.jackson.core.JsonParser.\_constructError(JsonParser .java:  
> 1284)  
> at  
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportError(P arserMinimalBase.java:  
> 588)  
> at  
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportInvalid EOF(ParserMinimalBase.java:  
> 521)  
> at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.addName(UTF 8StreamJsonParser.java:  
> 1817)  
> at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_handleUnus ualFieldName(UTF8StreamJsonParser.java:  
> 1597)  
> at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_parseField Name(UTF8StreamJsonParser.java:  
> 1233)  
> at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(U TF8StreamJsonParser.java:  
> 501)  
> at  
> org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXCo ntentParser.java:  
> 48)  
> at  
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 468)  
> ... 8 more
> 
> Can someone please help me and tell me what I'm missing or what I'm  
> doing wrong?
> 
> Thank you very much for your attention
> 
> --

--

---

<div class="post-metadata">

**Author:** ![Richard\_Louapre](https://avatars.discourse-cdn.com/v4/letter/r/e19adc/32.png) [@Richard\_Louapre](https://discuss.elastic.co/u/Richard_Louapre)\
**Post date:** [November 27, 2012, 5:50pm UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/4 "2012-11-27T17:50:04Z")

</div>

Hi,

Few people had the same issue. There are few json files samples of river  
settings in [1].  
For Windows users there is a full example including bat files here [2].

[1] -  
[https://github.com/richardwilly98/elasticsearch-river-mongodb/tree/master/resources](https://github.com/richardwilly98/elasticsearch-river-mongodb/tree/master/resources)  
[2] -  
[https://github.com/richardwilly98/elasticsearch-river-mongodb/tree/master/resources/issues/26](https://github.com/richardwilly98/elasticsearch-river-mongodb/tree/master/resources/issues/26)

Thanks,  
Richard.

On Saturday, November 24, 2012 10:31:14 AM UTC-5, Sanx El Santo wrote:

> Yessssss
> 
> Thank you very much David!!!
> 
> On 23 nov, 17:46, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote:
> 
> > Sounds like there are some bad chars here.  
> > Try this:
> > 
> > curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta'-d](http://localhost:9200/_river/mongodb/_meta'-d) '{"type":  
> > "mongodb","mongodb": {"db": "santix","collection": "posts"},"index":  
> > {"name": "mongoindex","type": "posts"}}'
> > 
> > Does it help?
> > 
> > --  
> > David 😉  
> > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> > 
> > Le 23 nov. 2012 à 22:48, Sanx El Santo [hectorg...@gmail.com](mailto:hectorg...@gmail.com) a écrit :
> > 
> > Greetings to all
> > 
> > I'm trying to integrate MongoDB with elasticsearch
> > 
> > 'm using this guide:
> > 
> > [http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mong](http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mong)...
> 
> > With following command in my terminal:
> > 
> > curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta'-d](http://localhost:9200/_river/mongodb/_meta'-d) '{  
> > "type": "mongodb",  
> > "mongodb": {  
> > "db": "santix",  
> > "collection": "posts"  
> > },  
> > "index": {  
> > "name": "mongoindex",  
> > "type": "posts"  
> > }
> > 
> > }'
> > 
> > and the output is:
> > 
> > {"error":"MapperParsingException[Failed to parse]; nested:  
> > JsonParseException[Unexpected end-of-input in field name\n at [Source:  
> > [B@1bfa1ba1; line: 2, column: 2]]; ","status":400}
> > 
> > and the elasticsearch output is:
> > 
> > [2012-11-23 10:25:12,843][DEBUG][action.index] [Rafferty]  
> > [\_river][0], node[q2OyKdZaRXGf-SMhPGSrSw], [P], s[STARTED]: Failed to  
> > execute [index {[\_river][mongodb][\_meta], source[{  
> > ??? "type": "mongodb",  
> > ??? "mongodb": {  
> > ??????? "db": "santix",  
> > ??????? "collection": "posts"  
> > ??? },  
> > ??? "index": {  
> > ??????? "name": "mongoindex",  
> > ??????? "type": "posts"  
> > ??? }}]}]
> > 
> > org.elasticsearch.index.mapper.MapperParsingException: Failed to parse  
> > at  
> > org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> > 509)  
> > at  
> > org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> > 438)  
> > at
> 
> org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(Inter  
> nalIndexShard.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary  
> (TransportIndexAction.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.action.support.replication.TransportShardReplicationOpera  
> tionAction
> 
> > 
> 
> $AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperat  
> ionAction.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.action.support.replication.TransportShardReplicationOpera  
> tionAction
> 
> > $AsyncShardOperationAction  
> > $1.run(TransportShardReplicationOperationAction.java:430)  
> > at java.util.concurrent.ThreadPoolExecutor  
> > $Worker.runTask(ThreadPoolExecutor.java:886)  
> > at java.util.concurrent.ThreadPoolExecutor  
> > $Worker.run(ThreadPoolExecutor.java:908)  
> > at java.lang.Thread.run(Thread.java:680)  
> > Caused by: org.elasticsearch.common.jackson.core.JsonParseException:  
> > Unexpected end-of-input in field name  
> > at [Source: [B@1bfa1ba1; line: 2, column: 2]  
> > at
> 
> org.elasticsearch.common.jackson.core.JsonParser.\_constructError(JsonParser  
> .java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportError(P  
> arserMinimalBase.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportInvalid  
> EOF(ParserMinimalBase.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.addName(UTF  
> 8StreamJsonParser.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_handleUnus  
> ualFieldName(UTF8StreamJsonParser.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_parseField  
> Name(UTF8StreamJsonParser.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(U  
> TF8StreamJsonParser.java:
> 
> > 1. 
> > 
> > at
> 
> org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXCo  
> ntentParser.java:
> 
> > 1. 
> > 
> > at  
> > org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> > 468)  
> > ... 8 more
> > 
> > Can someone please help me and tell me what I'm missing or what I'm  
> > doing wrong?
> > 
> > Thank you very much for your attention
> > 
> > --

--

---

<div class="post-metadata">

**Author:** ![Jordon](https://avatars.discourse-cdn.com/v4/letter/j/d2c977/32.png) [@Jordon](https://discuss.elastic.co/u/Jordon)\
**Post date:** [July 8, 2013, 10:42am UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/5 "2013-07-08T10:42:35Z")

</div>

How to create index for a attachment of pdf by using  
elasticsearch-river-mongodb: 1.6.9 (don't have any hits,or missing fields)

Dear All,  
I am new to elasticsearch. I have tried to follow the different tutorials  
and post on index and mapping attached pdf document in a mongodb database  
for days without success. After running the codes below i don't have any  
hits from words that exist in the mongodb attached files.

software version:  
MongoDB: mongodb-linux-x86\_64-2.4.3  
elasticsearch-river-mongodb: 1.6.9  
elasticsearch: 0.90  
elasticsearch-mapper-attachments: 1.7.0

_Problem No. 1_

* * *

1. BSON Structure, PDF attachment is in the "FileContent" field, the  
attachment is not in GridFS.  
byte fileser = iou.read(file);  
Pagecount = getpagenum(file);  
BasicDBObject articleobject = new BasicDBObject();  
articleobject.put("Title", jsonArray.getJSONObject(i).get("Title"));  
articleobject.put("Authors",jsonArray.getJSONObject(i).get("Authors"));  
articleobject.put("Organization",  
jsonArray.getJSONObject(i).get("Organization"));  
articleobject.put("Media", jsonArray.getJSONObject(i).get("Media"));  
articleobject.put("ISSN", jsonArray.getJSONObject(i).get("ISSN"));  
articleobject.put("Pages", jsonArray.getJSONObject(i).get("Pages"));  
articleobject.put("Pagecount", Pagecount);  
articleobject.put("Abstracts", jsonArray.getJSONObject(i).get("Abstracts"));  
articleobject.put("Keywords", "");  
articleobject.put("FileContent", fileser);  
collection.insert(articleobject);

* * *

1. create a index  
curl -XPUT "[http://localhost:9200/articleindex](http://localhost:9200/articleindex)"

* * *

1. create a mapping  
curl -XPUT '[http://localhost:9200/articleindex/cardiopathy/\_mapping](http://localhost:9200/articleindex/cardiopathy/_mapping)' -d '  
{  
"cardiopathy" : {  
"properties" : {  
"Authors" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Media" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Organization" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Keywords" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Title" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"ISSN" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Pages" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Abstracts" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"FileContent" : { "type" : "string" ,"indexAnalyzer":  
"ik","searchAnalyzer": "ik"}  
}  
}  
}'

* * *

1. create the river  
curl -XPUT "[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)" -d '  
{  
"type": "mongodb",  
"mongodb": {  
"host": "192.168.1.112",  
"port": "27107",  
"options": {"drop\_collection": true },  
"db": "ftsearch1",  
"collection": "pdf"  
},  
"index": {  
"name": "articleindex",  
"type": "cardiopathy"  
}  
}'

* * *

1. Retrieve the indexed document by the keyword  
curl -XGET [http://localhost:9200/articleindex/cardiopathy/\_search](http://localhost:9200/articleindex/cardiopathy/_search) -d'  
{  
"fields" : ["Title"],  
"query" : { "text" : { "FileContent" : "高血压病辨证分型与靶器官相关性研究的新进展" }}  
}  
'

{"took":179,"timed\_out":false,"\_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":0,"max\_score":null,"hits":}}

\*Problem No. 2 \*

* * *

alter mapping：

curl -XPUT '[http://localhost:9200/articleindex/cardiopathy/\_mapping](http://localhost:9200/articleindex/cardiopathy/_mapping)' -d '  
{  
"cardiopathy" : {  
"file" : {  
"properties" : {  
"Authors" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Media" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Organization" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Keywords" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Title" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"ISSN" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Pages" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"Abstracts" : { "type" : "string" ,"indexAnalyzer": "ik","searchAnalyzer":  
"ik","store" : "yes"},  
"FileContent" : {  
"type" : "attachment",  
"fields" : {  
"file" : { "indexAnalyzer": "ik","searchAnalyzer": "ik","store" : "yes",  
"index" : "analyzed" },  
"date" : { "store" : "yes" },  
"author" : { "store" : "yes" },  
"keywords" : { "store" : "yes" },  
"content\_type" : { "store" : "yes" },  
"title" : { "store" : "yes" }  
}  
}  
}  
}  
}  
}'

Retrieve the indexed document by the keyword：

{"took":63,"timed\_out":false,"\_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":0,"max\_score":null,"hits":}}

_Problem No. 3_

* * *

1. The attachment is in GridFS, in addition, we define the other fields.  
GridFSInputFile gfsFile = gfsPhoto.createFile(file);  
String filename = file.getName();  
filename = filename.substring(0, filename.lastIndexOf("."));  
gfsFile.setFilename(filename);  
gfsFile.put("Title", jsonArray.getJSONObject(i).get("Title"));  
gfsFile.put("Authors",jsonArray.getJSONObject(i).get("Authors"));  
gfsFile.put("Organization", jsonArray.getJSONObject(i).get("Organization"));  
gfsFile.put("Media", jsonArray.getJSONObject(i).get("Media"));  
gfsFile.put("ISSN", jsonArray.getJSONObject(i).get("ISSN"));  
gfsFile.put("Pages", jsonArray.getJSONObject(i).get("Pages"));  
gfsFile.put("Pagecount", Pagecount);  
gfsFile.put("Abstracts", jsonArray.getJSONObject(i).get("Abstracts"));  
gfsFile.put("Keywords", "");  
gfsFile.save();

* * *

1. create a index  
curl -XPUT "[http://localhost:9200/articleindex](http://localhost:9200/articleindex)"

* * *

1. create a mapping  
curl -XPUT '[http://localhost:9200/cardiopathyindex/cardiopathy/\_mapping](http://localhost:9200/cardiopathyindex/cardiopathy/_mapping)' -d  
'{  
"cardiopathy": {  
"properties" : {  
"content" : {  
"path" : "full",  
"type" : "attachment",  
"fields" : {  
"content" : {"type": "string","indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Authors" : {"type": "string","indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Media" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer": "ik"},  
"Organization" : {"type": "string","indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Keywords" : { "type" : "string" ,"indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Title" : {"type": "string","indexAnalyzer": "ik","searchAnalyzer": "ik"},  
"ISSN" : {"type": "string","indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Pages" : { "type" : "string" ,"indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"Abstracts" : { "type" : "string" ,"indexAnalyzer":  
"ik","searchAnalyzer": "ik"},  
"date" : {"format" : "dateOptionalTime","type" : "date" },  
"content\_type" : { "type" : "string" }  
}  
},  
"chunkSize" : { "type" : "long" },  
"md5" : { "type" : "string" },  
"length" : { "type" : "long" },  
"filename" : { "type" : "string" },  
"contentType" : { "type" : "string" },  
"uploadDate" : {  
"format" : "dateOptionalTime",  
"type" : "date"  
},  
"metadata" : { "type" : "object" }  
}  
}  
}'

* * *

1. create the river  
curl -XPUT "[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)" -d '  
{  
"type": "mongodb",  
"mongodb": {  
"host": "192.168.1.112",  
"port": "27107",  
"options": {"drop\_collection": true },  
"db": "ftsearch",  
"collection": "fs",  
"gridfs": true  
},  
"index": {  
"name": "cardiopathyindex",  
"type": "cardiopathy",  
"content\_type": "application/pdf"  
}  
}'

* * *

1. Retrieve the indexed document by the keyword, hit, but the query result  
is missing the "Title" and "Authors" fields.  
curl -XGET [http://localhost:9200/cardiopathyindex/cardiopathy/\_search](http://localhost:9200/cardiopathyindex/cardiopathy/_search) -d'  
{  
"fields" : ["Title","Authors"],  
"query" : { "text" : { "content" : "高血压病辨证分型与靶器官相关性研究的新进展" }}  
}  
'  
{"took":1005,"timed\_out":false,"\_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":96,"max\_score":0.68918943,"hits":[{"\_index":"cardiopathyindex","\_type":"cardiopathy","\_id":"51d972d5948516489d1674d1","\_score":0.68918943},{"\_index":"cardiopathyindex","\_type":"cardiopathy","\_id":"51d972db948516489d167545","\_score":0.22994329},{"\_index":"cardiopathyindex","\_type":"cardiopathy","\_id":"51d972da948516489d16752c","\_score":0.20929527},.......

在 2012年11月24日星期六UTC+8上午5时48分09秒，Sanx El Santo写道：

> Greetings to all
> 
> I'm trying to integrate MongoDB with elasticsearch
> 
> 'm using this guide:
> 
> [A complete guide to Integrating MongoDB with Elastic Search - Satish Gandham](http://satishgandham.com/2012/09/a-complete-guide-to-integrating-mongodb-with-elastic-search/)
> 
> With following command in my terminal:
> 
> curl -XPUT '[http://localhost:9200/\_river/mongodb/\_meta](http://localhost:9200/_river/mongodb/_meta)' -d '{  
> "type": "mongodb",  
> "mongodb": {  
> "db": "santix",  
> "collection": "posts"  
> },  
> "index": {  
> "name": "mongoindex",  
> "type": "posts"  
> }  
> }'
> 
> and the output is:
> 
> {"error":"MapperParsingException[Failed to parse]; nested:  
> JsonParseException[Unexpected end-of-input in field name\n at [Source:  
> [B@1bfa1ba1; line: 2, column: 2]]; ","status":400}
> 
> and the elasticsearch output is:
> 
> [2012-11-23 10:25:12,843][DEBUG][action.index] [Rafferty]  
> [\_river][0], node[q2OyKdZaRXGf-SMhPGSrSw], [P], s[STARTED]: Failed to  
> execute [index {[\_river][mongodb][\_meta], source[{  
> ??? "type": "mongodb",  
> ??? "mongodb": {  
> ??????? "db": "santix",  
> ??????? "collection": "posts"  
> ??? },  
> ??? "index": {  
> ??????? "name": "mongoindex",  
> ??????? "type": "posts"  
> ??? }  
> }]}]  
> org.elasticsearch.index.mapper.MapperParsingException: Failed to parse  
> at  
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 509)  
> at  
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 438)  
> at  
> org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:
> 
> 1. at  
> org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:
> 
> 2. at  
> org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction
> 
> $AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:
> 
> 1. at  
> org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction
> 
> $AsyncShardOperationAction  
> $1.run(TransportShardReplicationOperationAction.java:430)  
> at java.util.concurrent.ThreadPoolExecutor  
> $Worker.runTask(ThreadPoolExecutor.java:886)  
> at java.util.concurrent.ThreadPoolExecutor  
> $Worker.run(ThreadPoolExecutor.java:908)  
> at java.lang.Thread.run(Thread.java:680)  
> Caused by: org.elasticsearch.common.jackson.core.JsonParseException:  
> Unexpected end-of-input in field name  
> at [Source: [B@1bfa1ba1; line: 2, column: 2]  
> at  
> org.elasticsearch.common.jackson.core.JsonParser.\_constructError(JsonParser.java:
> 
> 1. at  
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportError(ParserMinimalBase.java:
> 
> 2. at  
> org.elasticsearch.common.jackson.core.base.ParserMinimalBase.\_reportInvalidEOF(ParserMinimalBase.java:
> 
> 3. at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.addName(UTF8StreamJsonParser.java:
> 
> 4. at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_handleUnusualFieldName(UTF8StreamJsonParser.java:
> 
> 5. at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.\_parseFieldName(UTF8StreamJsonParser.java:
> 
> 6. at  
> org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:
> 
> 7. at  
> org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:
> 
> 8. 
> 
> ```
> at 
> 
> ```
> 
> org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:  
> 468)  
> ... 8 more
> 
> Can someone please help me and tell me what I'm missing or what I'm  
> doing wrong?
> 
> Thank you very much for your attention

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:27am UTC](https://discuss.elastic.co/t/integrating-mongodb-with-elastic-search/9808/6 "2017-07-06T02:27:42Z")

</div>