# Using Logstash to upload to S3 log line by line

**URL:** <https://discuss.elastic.co/t/using-logstash-to-upload-to-s3-log-line-by-line/207807>\
**Category:** Logstash\
**Created:** [November 14, 2019, 5:12am UTC](https://discuss.elastic.co/t/using-logstash-to-upload-to-s3-log-line-by-line/207807 "2019-11-14T05:12:46Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ranika\_Madurawe](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ranika_madurawe/32/57638_2.png) [@Ranika\_Madurawe](https://discuss.elastic.co/u/Ranika_Madurawe)\
**Post date:** [November 14, 2019, 5:12am UTC](https://discuss.elastic.co/t/using-logstash-to-upload-to-s3-log-line-by-line/207807/1 "2019-11-14T05:12:47Z")

</div>

I am using LogStash to upload log files in a Volatile K8S system currently running on GCP.

I am aiming to upload log files to an AWS s3 bucket using LogStash s3 output plugin. As I understand from the documentation the LogStash s3 output will write received log line into a temporary file and by the user-defined size\_file and time\_file, will set limits for when LogStash will push the temporary files to the s3 bucket

However due to the nature of the system. It is impossible to correctly predict which time or size to push the temporary files always causing the final log lines not being pushed into the s3 bucket.

So is there to configure the s3 output plugin to push to s3 bucket as soon as it receives a logline  
preferably to the same file in the s3 bucket.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 12, 2019, 5:23am UTC](https://discuss.elastic.co/t/using-logstash-to-upload-to-s3-log-line-by-line/207807/2 "2019-12-12T05:23:43Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.