# How to load 2 Million record of CSV file's data to Elasticsearch in CentosOs 7? **URL:** \ **Category:** Elasticsearch\ **Created:** [June 4, 2015, 10:31am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919 "2015-06-04T10:31:03Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![anjithalk](https://avatars.discourse-cdn.com/v4/letter/a/8491ac/32.png) [@anjithalk](https://discuss.elastic.co/u/anjithalk)\ **Post date:** [June 4, 2015, 10:31am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/1 "2015-06-04T10:31:03Z")
What is the best way to load 2 million records of CSV file data to elastic search? Can I use spark for this purpose ? ---
**Author:** ![Jason\_Wee](https://avatars.discourse-cdn.com/v4/letter/j/7ea924/32.png) [@Jason\_Wee](https://discuss.elastic.co/u/Jason_Wee)\ **Post date:** [June 6, 2015, 10:36am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/2 "2015-06-06T10:36:03Z")
maybe csv to json and then stream to es? [https://github.com/elastic/stream2es](https://github.com/elastic/stream2es) ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 6, 2015, 11:15am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/3 "2015-06-06T11:15:32Z")
Have a look also at [http://david.pilato.fr/blog/2015/04/28/exploring-capitaine-train-dataset/](http://david.pilato.fr/blog/2015/04/28/exploring-capitaine-train-dataset/) ---
**Author:** ![anjithalk](https://avatars.discourse-cdn.com/v4/letter/a/8491ac/32.png) [@anjithalk](https://discuss.elastic.co/u/anjithalk)\ **Post date:** [June 11, 2015, 5:04am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/4 "2015-06-11T05:04:58Z")
Thank you but this solution take ages to run million records. However thank you at least its working for small amount of data ---
**Author:** ![anjithalk](https://avatars.discourse-cdn.com/v4/letter/a/8491ac/32.png) [@anjithalk](https://discuss.elastic.co/u/anjithalk)\ **Post date:** [June 11, 2015, 5:08am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/5 "2015-06-11T05:08:53Z")
@ Jason Thank you. I couldn't make it work. Spark also has streaming ... [https://spark.apache.org/docs/latest/streaming-programming-guide.html](https://spark.apache.org/docs/latest/streaming-programming-guide.html) will this work for me in large amount of data ? ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 11, 2015, 5:22am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/6 "2015-06-11T05:22:59Z")
You can increase the number of workers of Logstash and set it to the number of CPU you have on your machine. ---
**Author:** ![Jason\_Wee](https://avatars.discourse-cdn.com/v4/letter/j/7ea924/32.png) [@Jason\_Wee](https://discuss.elastic.co/u/Jason_Wee)\ **Post date:** [June 11, 2015, 11:46am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/7 "2015-06-11T11:46:11Z")
that's sad... or you can pay someone to do it for you 🙂 ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:08am UTC](https://discuss.elastic.co/t/how-to-load-2-million-record-of-csv-files-data-to-elasticsearch-in-centosos-7/1919/8 "2017-07-06T00:08:12Z")