Duplicate postgres logs appearing in output

Elastic Stack Logstash
1

I posted here: stackoverflow but I think this forum is probably better suited to helping me solve my problem.

I basically have a postgres server generating logs like so:
postgresql-Sat.csv
postgresql-Sun.csv
postgresql-Mon.csv
postgresql-Tue.csv
postgresql-Wed.csv
postgresql-Thu.csv
postgresql-Fri.csv

My input/output is very simple:
input {
file {
path => '/pglog/postgresql-*.csv'
type => 'postgres_csv'
}
}
output {
file {
path => '/pglog/test_logstash.output'
}
}

But after 24 hours I'm seeing TONS of duplicate logs in /pglog/test_logstash.output
The sincedb files are indeed being updated, and there is only one agent running on this box.

Any ideas how I can trouble shoot this?

My guess is that postgres's logs are somehow confusing logstash, but I don't understand how I can fix this.

Any ideas?

2

If you start Logstash with --verbose it'll output sincedb stuff to the log. That might give clues about what's going on.