River-csv plugin


(HansPeterSloot) #1

Hi,

This is for elasticsearch : elasticsearch-1.3.2-1.noarch
There are 2 nodes in the cluster.
I have installed the river-csv pluging.

When loading a file with 5 million rows loading stops after 477400 rows.

I load with :
curl -XPUT localhost:9200/_river/my_csv_river/_meta -d '
{
"type" : "csv",
"csv_file" : {
"folder" : "/u01/app/div",
"first_line_is_header":"true"
}
}'

In the logfile I see :
[2014-08-18 14:44:53,216][INFO
][org.agileworks.elasticsearch.river.csv.CSVRiver] [Stanley]
[csv][my_csv_river] Going to execute new bulk composed of 100 actions
[2014-08-18 14:44:53,275][INFO
][org.agileworks.elasticsearch.river.csv.CSVRiver] [Stanley]
[csv][my_csv_river] Executed bulk composed of 100 actions
[2014-08-18 14:44:53,280][INFO
][org.agileworks.elasticsearch.river.csv.CSVRiver] [Stanley]
[csv][my_csv_river] Going to execute new bulk composed of 100 actions
[2014-08-18 14:44:53,299][INFO
][org.agileworks.elasticsearch.river.csv.CSVRiver] [Stanley]
[csv][my_csv_river] Executed bulk composed of 100 actions
[2014-08-18 14:44:53,385][INFO
][org.agileworks.elasticsearch.river.csv.CSVRiver] [Stanley]
[csv][my_csv_river] Executed bulk composed of 100 actions

./es -v indices
status name pri rep size bytes docs
green _river 1 1 15452 2
green my_csv_river 5 1 296047073 477400

Am I doing something wrong?

Regards HansP

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/76cafcc4-9966-4c0b-b891-b18b9376a74f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #2