Meet a problem while indexing local json files by fsriver

Elastic Stack Elasticsearch
1 
    I have some json files under /home/admin/tutorial, and I find

fsriver(https://github.com/dadoonet/fsriver) can index the json files
directly.
So I followed the guide:
curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa asoqa51@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find fsriver(https://github.com/dadoonet/fsriver) can index the json files directly.
    So I followed the guide:

curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：

What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr
| @scrutmydocs https://twitter.com/scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa <aso...@gmail.com <javascript:>> a écrit :

    I have some json files under /home/admin/tutorial, and I find

fsriver(GitHub - dadoonet/fscrawler: Elasticsearch File System Crawler (FS Crawler)) can index the json files
directly.
So I followed the guide:
curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

4

It works with FSRiver 0.0.3

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 20 févr. 2013 à 03:29, asoqa asoqa51@gmail.com a écrit :

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：

What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa aso...@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find fsriver(https://github.com/dadoonet/fsriver) can index the json files directly.
    So I followed the guide:

curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

5

download FSRiver 0.0.3 failed
-> Installing fr.pilato.elasticsearch.river/fsriver/0.0.3...
Trying https:
//github.com/downloads/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip...
Trying https:
//github.com/fr.pilato.elasticsearch.river/fsriver/zipball/v0.0.3...
Failed to install fr.pilato.elasticsearch.river/fsriver/0.0.3, reason:failed to download

the download site seems different from which in your guide(

http://download.elasticsearch.org/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip

)

在 2013年2月20日星期三UTC+8下午3时45分37秒，David Pilato写道：

It works with FSRiver 0.0.3

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 20 févr. 2013 à 03:29, asoqa <aso...@gmail.com <javascript:>> a écrit :

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：

What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr
| @scrutmydocs https://twitter.com/scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa aso...@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find

fsriver(GitHub - dadoonet/fscrawler: Elasticsearch File System Crawler (FS Crawler)) can index the json files
directly.
So I followed the guide:
curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

6

You are probably using ES 0.19.x instead of 0.20.x

David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 20 févr. 2013 à 09:06, asoqa asoqa51@gmail.com a écrit :

download FSRiver 0.0.3 failed
-> Installing fr.pilato.elasticsearch.river/fsriver/0.0.3...
Trying https://github.com/downloads/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip...
Trying https://github.com/fr.pilato.elasticsearch.river/fsriver/zipball/v0.0.3...
Failed to install fr.pilato.elasticsearch.river/fsriver/0.0.3, reason: failed to download

the download site seems different from which in your guide(
http://download.elasticsearch.org/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip
)

在 2013年2月20日星期三UTC+8下午3时45分37秒，David Pilato写道：
It works with FSRiver 0.0.3

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 20 févr. 2013 à 03:29, asoqa aso...@gmail.com a écrit :

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：
What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa aso...@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find fsriver(https://github.com/dadoonet/fsriver) can index the json files directly.
    So I followed the guide:

curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

7

So, I must upgrade my ES to 0.20.x?

在 2013年2月20日星期三UTC+8下午4时21分56秒，David Pilato写道：

You are probably using ES 0.19.x instead of 0.20.x

David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr
| @scrutmydocs https://twitter.com/scrutmydocs

Le 20 févr. 2013 à 09:06, asoqa <aso...@gmail.com <javascript:>> a écrit :

download FSRiver 0.0.3 failed
-> Installing fr.pilato.elasticsearch.river/fsriver/0.0.3...
Trying https://
github.com/downloads/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip
...
Trying https://
github.com/fr.pilato.elasticsearch.river/fsriver/zipball/v0.0.3...
Failed to install fr.pilato.elasticsearch.river/fsriver/0.0.3, reason:failed to download

the download site seems different from which in your guide(

http://download.elasticsearch.org/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip

)

在 2013年2月20日星期三UTC+8下午3时45分37秒，David Pilato写道：

It works with FSRiver 0.0.3

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 20 févr. 2013 à 03:29, asoqa aso...@gmail.com a écrit :

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：

What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | *Elasticsearch.comhttp://elasticsearch.com/
*
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr
| @scrutmydocs https://twitter.com/scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa aso...@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find

fsriver(GitHub - dadoonet/fscrawler: Elasticsearch File System Crawler (FS Crawler)) can index the json files
directly.
So I followed the guide:
curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

8

I did not test it on 0.19, but it should work.
Just you can't use bin/plugin 0.19 because it does not search artifacts on maven central and sonatype.

So download it your self from here: https://oss.sonatype.org/service/local/repositories/releases/content/fr/pilato/elasticsearch/river/fsriver/0.0.3/fsriver-0.0.3.zip

And unzip it in place of 0.0.2 in plugins folder.

I think it should work.

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 20 févr. 2013 à 09:27, asoqa asoqa51@gmail.com a écrit :

So, I must upgrade my ES to 0.20.x?

在 2013年2月20日星期三UTC+8下午4时21分56秒，David Pilato写道：
You are probably using ES 0.19.x instead of 0.20.x

David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 20 févr. 2013 à 09:06, asoqa aso...@gmail.com a écrit :

download FSRiver 0.0.3 failed
-> Installing fr.pilato.elasticsearch.river/fsriver/0.0.3...
Trying https://github.com/downloads/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip...
Trying https://github.com/fr.pilato.elasticsearch.river/fsriver/zipball/v0.0.3...
Failed to install fr.pilato.elasticsearch.river/fsriver/0.0.3, reason: failed to download

the download site seems different from which in your guide(
http://download.elasticsearch.org/fr.pilato.elasticsearch.river/fsriver/fsriver-0.0.3.zip
)

在 2013年2月20日星期三UTC+8下午3时45分37秒，David Pilato写道：
It works with FSRiver 0.0.3

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 20 févr. 2013 à 03:29, asoqa aso...@gmail.com a écrit :

es: 0.19.11
fsriver: 0.0.2

在 2013年2月19日星期二UTC+8下午8时03分29秒，David Pilato写道：
What version of FS River and ES are you using?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 19 févr. 2013 à 13:00, asoqa aso...@gmail.com a écrit :

    I have some json files under /home/admin/tutorial, and I find fsriver(https://github.com/dadoonet/fsriver) can index the json files directly.
    So I followed the guide:

curl -XPUT 'localhost:9200/_river/scrapy/_meta' -d '{
"type":"fs",
"fs":{
"name":"scrapy json",
"url":"/home/admin/tutorial",
"update_rate":36000,
"json_support":true
},
"index":{
"index":"scrapy",
"type":"doc",
"bulk_size":50
}
}'

It returns ok. But it index nothing, there is no index at all.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.