Did you read the link I sent about versions?
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 5 mai 2014 à 20:19:56, John Ottosson (john.a.ottosson@gmail.com) a écrit:
ok, i installed 0.90.10 version of elasticsearch instead and rebooted, mounted the image again and tried to index the files
it seems to fail to get _meta from fs mydocs, not sure what im doing wrong.
im running
java version "1.7.0_55"
elasticsearch 0.90.10
fsriver 1.0.0
curl 7.35.0
php 5.5.9
output of var/log/..
[2014-05-05 19:58:33,545][INFO ][node ] [Rax] version[0.90.10], pid[2066], build[0a5781f/2014-01-10T10:18:37Z]
[2014-05-05 19:58:33,545][INFO ][node ] [Rax] initializing ...
[2014-05-05 19:58:33,585][INFO ][plugins ] [Rax] loaded [river-fs], sites []
[2014-05-05 19:58:35,307][INFO ][node ] [Rax] initialized
[2014-05-05 19:58:35,308][INFO ][node ] [Rax] starting ...
[2014-05-05 19:58:35,363][INFO ][transport ] [Rax] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.1.65:9300]}
[2014-05-05 19:58:38,426][INFO ][cluster.service ] [Rax] new_master [Rax][jG-qvr0jRTyMmvR9-NkrYA][inet[/192.168.1.65:9300]], reason: zen-disco-join (elected_as_master)
[2014-05-05 19:58:38,454][INFO ][discovery ] [Rax] elasticsearch/jG-qvr0jRTyMmvR9-NkrYA
[2014-05-05 19:58:38,469][INFO ][http ] [Rax] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.1.65:9200]}
[2014-05-05 19:58:38,470][INFO ][node ] [Rax] started
[2014-05-05 19:58:38,554][INFO ][gateway ] [Rax] recovered [0] indices into cluster_state
[2014-05-05 19:58:42,667][INFO ][node ] [Rax] stopping ...
[2014-05-05 19:58:42,683][INFO ][node ] [Rax] stopped
[2014-05-05 19:58:42,683][INFO ][node ] [Rax] closing ...
[2014-05-05 19:58:42,714][INFO ][node ] [Rax] closed
[2014-05-05 19:59:27,032][INFO ][node ] [N'Gabthoth] version[0.90.10], pid[1142], build[0a5781f/2014-01-10T10:18:37Z]
[2014-05-05 19:59:27,053][INFO ][node ] [N'Gabthoth] initializing ...
[2014-05-05 19:59:27,626][INFO ][plugins ] [N'Gabthoth] loaded [river-fs], sites []
[2014-05-05 19:59:30,355][INFO ][node ] [N'Gabthoth] initialized
[2014-05-05 19:59:30,355][INFO ][node ] [N'Gabthoth] starting ...
[2014-05-05 19:59:30,486][INFO ][transport ] [N'Gabthoth] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.1.65:9300]}
[2014-05-05 19:59:33,658][INFO ][cluster.service ] [N'Gabthoth] new_master [N'Gabthoth][SBeWzhj0Sp2VIDME6n9khA][inet[/192.168.1.65:9300]], reason: zen-disco-join (elected_as_master)
[2014-05-05 19:59:33,789][INFO ][discovery ] [N'Gabthoth] elasticsearch/SBeWzhj0Sp2VIDME6n9khA
[2014-05-05 19:59:33,799][INFO ][http ] [N'Gabthoth] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.1.65:9200]}
[2014-05-05 19:59:33,800][INFO ][node ] [N'Gabthoth] started
[2014-05-05 19:59:33,908][INFO ][gateway ] [N'Gabthoth] recovered [0] indices into cluster_state
[2014-05-05 19:59:57,578][INFO ][cluster.metadata ] [N'Gabthoth] [mydocs] creating index, cause [api], shards [5]/[1], mappings []
[2014-05-05 20:00:10,153][INFO ][cluster.metadata ] [N'Gabthoth] [_river] creating index, cause [auto(index api)], shards [1]/[1], mappings []
[2014-05-05 20:00:10,311][INFO ][cluster.metadata ] [N'Gabthoth] [_river] update_mapping [mydocs] (dynamic)
[2014-05-05 20:00:10,325][INFO ][river.routing ] [N'Gabthoth] no river _meta document found, retrying in 1000 ms
[2014-05-05 20:00:11,343][WARN ][fr.pilato.elasticsearch.river.fs.river.FsRiver] [N'Gabthoth] [fs][mydocs] fs.name attribute is deprecated. Don't use it anymore.
[2014-05-05 20:00:11,344][INFO ][fr.pilato.elasticsearch.river.fs.river.FsRiver] [N'Gabthoth] [fs][mydocs] Starting fs river scanning
[2014-05-05 20:00:11,389][INFO ][cluster.metadata ] [N'Gabthoth] [index] creating index, cause [api], shards [5]/[1], mappings []
[2014-05-05 20:00:11,492][WARN ][river ] [N'Gabthoth] failed to get _meta from [fs]/[mydocs]
java.lang.NoSuchMethodError: org.elasticsearch.action.admin.cluster.state.ClusterStateRequestBuilder.setIndices([Ljava/lang/String;)Lorg/elasticsearch/action/admin/cluster/state/ClusterStateRequestBuilder;
at fr.pilato.elasticsearch.river.fs.river.FsRiver.isMappingExist(FsRiver.java:303)
at fr.pilato.elasticsearch.river.fs.river.FsRiver.pushMapping(FsRiver.java:318)
at fr.pilato.elasticsearch.river.fs.river.FsRiver.start(FsRiver.java:231)
at org.elasticsearch.river.RiversService.createRiver(RiversService.java:147)
at org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:272)
at org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:266)
at org.elasticsearch.action.support.TransportAction$ThreadedActionListener$1.run(TransportAction.java:93)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2014-05-05 19:13 GMT+02:00 David Pilato david@pilato.fr:
fsriver 1.0.0 does not work with elasticsearch 0.90.7
Look here for older versions: https://github.com/dadoonet/fsriver/tree/es-0.90
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 5 mai 2014 à 18:41:03, John Ottosson (john.a.ottosson@gmail.com) a écrit:
the url is not the issue, i renamed it in this text.
2014-05-05 18:39 GMT+02:00 John Ottosson john.a.ottosson@gmail.com:
more..
[2014-05-05 18:16:35,335][INFO ][node ] [Valerie Cooper] version[1.1.1], pid[1258], build[f1585f0/2014-04-16T14:27:12Z]
[2014-05-05 18:16:35,336][INFO ][node ] [Valerie Cooper] initializing ...
[2014-05-05 18:16:35,897][INFO ][plugins ] [Valerie Cooper] loaded [river-fs], sites []
[2014-05-05 18:16:39,112][INFO ][node ] [Valerie Cooper] initialized
[2014-05-05 18:16:39,112][INFO ][node ] [Valerie Cooper] starting ...
[2014-05-05 18:16:39,286][INFO ][transport ] [Valerie Cooper] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.1.65:9300]}
[2014-05-05 18:16:42,415][INFO ][cluster.service ] [Valerie Cooper] new_master [Valerie Cooper][fxeE0FUbR-WR1_0-vx_RZw][duster][inet[/192.168.1.65:9300]], reason:
zen-disco-join (elected_as_master)
[2014-05-05 18:16:42,450][INFO ][discovery ] [Valerie Cooper] elasticsearch/fxeE0FUbR-WR1_0-vx_RZw
[2014-05-05 18:16:42,470][INFO ][http ] [Valerie Cooper] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.1.65:9200]}
[2014-05-05 18:16:42,541][INFO ][gateway ] [Valerie Cooper] recovered [0] indices into cluster_state
[2014-05-05 18:16:42,542][INFO ][node ] [Valerie Cooper] started
[2014-05-05 18:21:40,646][INFO ][cluster.metadata ] [Valerie Cooper] [_river] creating index, cause [auto(index api)], shards [1]/[1], mappings []
[2014-05-05 18:21:40,959][INFO ][cluster.metadata ] [Valerie Cooper] [_river] update_mapping [mydocs] (dynamic)
[2014-05-05 18:21:41,983][WARN ][river.routing ] [Valerie Cooper] no river type provided for [_river], ignoring...
[2014-05-05 18:23:11,827][DEBUG][action.index ] [Valerie Cooper] [_river][0], node[fxeE0FUbR-WR1_0-vx_RZw], [P], s[STARTED]: Failed to execute [index {[_river][
mydocs][_meta], source[{
"type": "fs",
"fs": {
"name": "mnt",
"url": "/mnt/filer/"
},
"index": {
"index": "index",
"type": "doc"
}
]}]
org.elasticsearch.index.mapper.MapperParsingException: failed to parse
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:540)
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:462)
at org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:384)
at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:203)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.elasticsearch.common.jackson.core.JsonParseException: Unexpected end-of-input: expected close marker for OBJECT (from [Source: [B@35580b3a; line: 1, column: 0])
at [Source: [B@35580b3a; line: 13, column: 145]
at org.elasticsearch.common.jackson.core.JsonParser._constructError(JsonParser.java:1524)
at org.elasticsearch.common.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:557)
at org.elasticsearch.common.jackson.core.base.ParserMinimalBase._reportInvalidEOF(ParserMinimalBase.java:487)
at org.elasticsearch.common.jackson.core.base.ParserBase._handleEOF(ParserBase.java:487)
at org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser._skipWSOrEnd(UTF8StreamJsonParser.java:2588)
at org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:649)
at org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:50)
at org.elasticsearch.index.mapper.object.ObjectMapper.parse(ObjectMapper.java:471)
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:515)
... 8 more
2014-05-05 18:29 GMT+02:00 John Ottosson john.a.ottosson@gmail.com:
Hi, I tried reinstalling elasticsearch and fsriver, when trying to connect to localhost it failed, perhaps some setting i missed. it said curl: (7) Failed to connect to localhost port 9200: Connection refused, i used the ip adress instead and got this in the var/log/elasticsearch/elasticsearch.log
[2014-05-05 18:16:35,335][INFO ][node ] [Valerie Cooper] version[1.1.1], pid[1258], build[f1585f0/2014-04-16T14:27:12Z]
[2014-05-05 18:16:35,336][INFO ][node ] [Valerie Cooper] initializing ...
[2014-05-05 18:16:35,897][INFO ][plugins ] [Valerie Cooper] loaded [river-fs], sites []
[2014-05-05 18:16:39,112][INFO ][node ] [Valerie Cooper] initialized
[2014-05-05 18:16:39,112][INFO ][node ] [Valerie Cooper] starting ...
[2014-05-05 18:16:39,286][INFO ][transport ] [Valerie Cooper] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/192.168.1.65:9300]}
[2014-05-05 18:16:42,415][INFO ][cluster.service ] [Valerie Cooper] new_master [Valerie Cooper][fxeE0FUbR-WR1_0-vx_RZw][duster][inet[/192.168.1.65:9300]], reason: zen-disco-join (elected_as_master)
[2014-05-05 18:16:42,450][INFO ][discovery ] [Valerie Cooper] elasticsearch/fxeE0FUbR-WR1_0-vx_RZw
[2014-05-05 18:16:42,470][INFO ][http ] [Valerie Cooper] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/192.168.1.65:9200]}
[2014-05-05 18:16:42,541][INFO ][gateway ] [Valerie Cooper] recovered [0] indices into cluster_state
[2014-05-05 18:16:42,542][INFO ][node ] [Valerie Cooper] started
[2014-05-05 18:21:40,646][INFO ][cluster.metadata ] [Valerie Cooper] [_river] creating index, cause [auto(index api)], shards [1]/[1], mappings []
[2014-05-05 18:21:40,959][INFO ][cluster.metadata ] [Valerie Cooper] [_river] update_mapping [mydocs] (dynamic)
[2014-05-05 18:21:41,983][WARN ][river.routing ] [Valerie Cooper] no river type provided for [_river], ignoring...
[2014-05-05 18:23:11,827][DEBUG][action.index ] [Valerie Cooper] [_river][0], node[fxeE0FUbR-WR1_0-vx_RZw], [P], s[STARTED]: Failed to execute [index {[_river][mydocs][_meta], source[{
"type": "fs",
"fs": {
"name": "mnt",
"url": "/mnt/files/"
},
"index": {
"index": "index",
"type": "doc"
}
]}]
org.elasticsearch.index.mapper.MapperParsingException: failed to parse
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:540)
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:462)
at org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:384)
at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:203)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.elasticsearch.common.jackson.core.JsonParseException: Unexpected end-of-input: expected close marker for OBJECT (from [Source: [B@35580b3a; line: 1, column: 0])
at [Source: [B@35580b3a; line: 13, column: 145]
at org.elasticsearch.common.jackson.core.JsonParser._constructError(JsonParser.java:1524)
at org.elasticsearch.common.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:557)
at org.elasticsearch.common.jackson.core.base.ParserMinimalBase._reportInvalidEOF(ParserMinimalBase.java:487)
at org.elasticsearch.common.jackson.core.base.ParserBase._handleEOF(ParserBase.java:487)
at org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser._skipWSOrEnd(UTF8StreamJsonParser.java:2588)
at org.elasticsearch.common.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:649)
at org.elasticsearch.common.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:50)
at org.elasticsearch.index.mapper.object.ObjectMapper.parse(ObjectMapper.java:471)
at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:515)
... 8 more
2014-05-05 16:42 GMT+02:00 David Pilato david@pilato.fr:
Do you see anything in logs?
--
David 
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 5 mai 2014 à 15:50, John Ottosson john.a.ottosson@gmail.com a écrit :
Ive got some problems getting fsriver to index my files, ive got a diskimage mounted on /mnt/ and it contains a folder files containing files. I am running this on a single server for testing purposes.
When I try to index the files in the folder with:
curl -XPUT 'localhost:9200/_river/mydocs/_meta' -d '{
"type": "fs",
"fs": {
"name": "mnt",
"url": "/mnt/files/"
},
"index": {
"index": "index",
"type": "doc"
}
}'
the folder contains 1gig of data in various formats and the command only produces:
{"ok":true,"_index":"_river","_type":"mydocs","_id":"_meta","_version":17}
i can see that it updates the version but it does not produce any index to my knowledge.
GET /_river/mydocs/_search returns with a blank.
curl -XGET 'http://localhost:9200/'
{
"ok" : true,
"status" : 200,
"name" : "Sigyn",
"version" : {
"number" : "0.90.7",
"build_hash" : "36897d07dadcb70886db7f149e645ed3d44eb5f2",
"build_timestamp" : "2013-11-13T12:06:54Z",
"build_snapshot" : false,
"lucene_version" : "4.5.1"
},
"tagline" : "You Know, for Search"
fsriver version 1.0.0
Thankful for any help with this matter.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/lTh_NpkkO4Q/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1826A460-98E9-4905-8897-650C22B2D11D%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJBsOReskjidZYtwfy9AMWO5PW7ucKNEgQ5UTxjcpxzdeHbTpA%40mail.gmail.com.
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/lTh_NpkkO4Q/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/etPan.5367c6ba.7545e146.5c36%40MacBook-Air-de-David.local.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJBsORfJRh3rRD02h_%3DgBU0sEv9Yxjqt0OsVwT0RWoVyss1P7Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/etPan.5367da16.6b68079a.5c36%40MacBook-Air-de-David.local.
For more options, visit https://groups.google.com/d/optout.
