# Log files getting accumulated in temporary\_directory path while reading logs from s3 buckets

**URL:** <https://discuss.elastic.co/t/log-files-getting-accumulated-in-temporary-directory-path-while-reading-logs-from-s3-buckets/329838>\
**Category:** Logstash\
**Created:** [April 12, 2023, 1:18pm UTC](https://discuss.elastic.co/t/log-files-getting-accumulated-in-temporary-directory-path-while-reading-logs-from-s3-buckets/329838 "2023-04-12T13:18:17Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [April 12, 2023, 4:23pm UTC](https://discuss.elastic.co/t/log-files-getting-accumulated-in-temporary-directory-path-while-reading-logs-from-s3-buckets/329838/2 "2023-04-12T16:23:58Z")

</div>

> [@Anusha\_Kusanghi](#):
>
> **Issue1** : we are seeing the logs files are getting accumulated in path specified in temporary directory.

The input transfers the file from s3 to the temporary directory before processing it. It always tries to delete the file after processing it. See [this](https://discuss.elastic.co/t/s3-input-plugin-does-not-delete-the-temporary-files/253483) thread for more info.

> [@Anusha\_Kusanghi](#):
>
> **Issue2** : Constantly seeing
> 
> `[2023-04-12T12:06:50,555][WARN][org.logstash.Event][imperva_shipper] Unrecognized @timestamp value type=class org.jruby.RubyFixnum`
> 
> incoming data: `{ ... "_@timestamp":1677229422000,`

The json codec does not support timestamps in UNIXMS format. You could remove the codec, use mutate+gsub the change the fieldname from "@timestamp" to something else, then use a date filter to parse it and overwrite [@timestamp].

---

_[View the full topic](https://discuss.elastic.co/t/log-files-getting-accumulated-in-temporary-directory-path-while-reading-logs-from-s3-buckets/329838)._