# Splitted huge csv file to less ones - fastest way to indexing using logstash/pipeline or filebeat?

**URL:** <https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742>\
**Category:** Logstash\
**Created:** [February 4, 2020, 8:32am UTC](https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742 "2020-02-04T08:32:45Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Datakids](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/datakids/32/39622_2.png) [@Datakids](https://discuss.elastic.co/u/Datakids)\
**Post date:** [February 4, 2020, 8:32am UTC](https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742/1 "2020-02-04T08:32:45Z")

</div>

Hi there,  
I just have a little question to manage following case:

I have mega huge csv files which I consider to split to less big files in same folder due to the fact  
indexing big csv files may take 2 or 4 days of writing.

What I want to know is best practice:

Lets say:  
1 big file = 4 days (no way)  
Ok lets split into 10 under path =\> "C:/Folder/Elastic/7.5.0/\*.csv"  
All using the same config file (so all ended in same index)

What should I use to be fast and easy:  
a: logstash pipeline.yml ?  
b: filebeat ?  
c: 10 time logstash instances ?

I'm familar with logstash and fielebeat and how to do set it up but I have no idea how to logstash pipeline may do this job as well or faster or even how to set up the logstash pipeline.yml!?

Welcome yr suggestions  
Regards

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 3, 2020, 8:37am UTC](https://discuss.elastic.co/t/splitted-huge-csv-file-to-less-ones-fastest-way-to-indexing-using-logstash-pipeline-or-filebeat/217742/2 "2020-03-03T08:37:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
