# Continuous monitoring of csv files using logstash creating one issue of duplicate records **URL:** \ **Category:** Logstash\ **Created:** [June 16, 2016, 2:02pm UTC](https://discuss.elastic.co/t/continuous-monitoring-of-csv-files-using-logstash-creating-one-issue-of-duplicate-records/53003 "2016-06-16T14:02:13Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![rupal](https://avatars.discourse-cdn.com/v4/letter/r/5f9b8f/32.png) [@rupal](https://discuss.elastic.co/u/rupal)\ **Post date:** [June 16, 2016, 2:02pm UTC](https://discuss.elastic.co/t/continuous-monitoring-of-csv-files-using-logstash-creating-one-issue-of-duplicate-records/53003/1 "2016-06-16T14:02:13Z")
When we are using start\_position parameter as "beginning" and running logstash conf file. Its start monitoring records but as and when I update same csv file(while continuous monitoring) with one new record, All of the records get monitored again and it results in duplicate events. And if I am using "end" for some other logstash conf file as start\_position then it doesnot start monitoring file. It stops by printing "pipeline started".. ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [June 17, 2016, 6:06am UTC](https://discuss.elastic.co/t/continuous-monitoring-of-csv-files-using-logstash-creating-one-issue-of-duplicate-records/53003/2 "2016-06-17T06:06:21Z")
It sounds like you're not actually updating the original file in place (with e.g. `echo "new data" >> file.csv`) but rather using a text editor that rewrites the file from scratch. You can't do that if you have `start_position => beginning`. ---
**Author:** ![rupal](https://avatars.discourse-cdn.com/v4/letter/r/5f9b8f/32.png) [@rupal](https://discuss.elastic.co/u/rupal)\ **Post date:** [June 17, 2016, 6:47am UTC](https://discuss.elastic.co/t/continuous-monitoring-of-csv-files-using-logstash-creating-one-issue-of-duplicate-records/53003/3 "2016-06-17T06:47:07Z")
I tried using start\_position =\> end and appended a line using echo in existing csv file. But it did not read file at all. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:52am UTC](https://discuss.elastic.co/t/continuous-monitoring-of-csv-files-using-logstash-creating-one-issue-of-duplicate-records/53003/4 "2017-07-06T04:52:20Z")
Closed on July 6, 2017, 4:52am UTC