# Duplicate records when scaling logstash **URL:** https://discuss.elastic.co/t/duplicate-records-when-scaling-logstash/43252 **Category:** Logstash **Created:** [March 2, 2016, 1:23pm UTC](https://discuss.elastic.co/t/duplicate-records-when-scaling-logstash/43252 "2016-03-02T13:23:59Z") **Posts on this page:** 1 **Showing post:** 6
### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist) #### Post date: [December 28, 2016, 5:03pm UTC](https://discuss.elastic.co/t/duplicate-records-when-scaling-logstash/43252/6 "2016-12-28T17:03:26Z")
Have a look at the following threads: > [@Logstash not creating right number of documents when passing folder as an argument](https://discuss.elastic.co/t/logstash-not-creating-right-number-of-documents-when-passing-folder-as-an-argument/69720): > > Hi, What I'm doing: Created 4 conf files under a root directory called XYZ. Each of these conf files will import 1000 rows from SQL and tables being imported are unique in all 4 conf files. when ran separately the number of documents created are 1000 in each index but when running conf file with root folder as argument the count is not 1000 in indexes. I've also observed each index is picking different document. I'm also using templates for each of the index and template name is different all … > [@Logstash and multiple pipelines. Why are my pipelines merging?](https://discuss.elastic.co/t/logstash-and-multiple-pipelines-why-are-my-pipelines-merging/68920): > > Hi stashers, I have two pipelines, A & B, both configured to process separate CSV files of different formats into separate indexes on the same Elastic Cloud cluster. Something very peculiar (to me...) is happening when they are both running in the same logstash 5.0.0 (can I use higher level versions of LS with ES 5.0.0?). A input: /path/to/As/\*.csv filter: lots of csv columns, make some fields lowercase, convert fields to types, prepend "A-" to a field to use for the index name, match date o… --- _[View the full topic](https://discuss.elastic.co/t/duplicate-records-when-scaling-logstash/43252)._