Hi again!!
We are having a problem with stopping ELK at night, we are getting a lot of duplicated documents, every time a log trace file rotates while ELK is stopped, when ELK starts again, every file from rotated file get ingested again.
I mean, we ingest for example "trace.log*", having 10 files for rotation, if "trace.log" rotates at night (while ELK is down) when it starts, trace.log, trace.log.1, trace.log.2, ..., trace.log.10 get ingested AGAIN, so we get thousands of duplicated documents.
Can you please look at this?
https://discuss.elastic.co/t/duplicated-documents-when-log-file-is-rotated-while-elk-is-down/225655
Thanks a lot!