# Logstash pipeline currently forwarding logs to elasticsearch

**URL:** https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197
**Category:** Elasticsearch
**Created:** [June 14, 2022, 7:15pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197 "2022-06-14T19:15:50Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![lhmzhou](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lhmzhou/32/83581_2.png) [@lhmzhou](https://discuss.elastic.co/u/lhmzhou)
#### Post date: [June 14, 2022, 7:15pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/1 "2022-06-14T19:15:51Z")

</div>

Hi,

Currently, I have a logstash pipeline that is forwarding logs to Elasticsearch. I am planning to send logfiles to S3 as a batch using the `aws s3` cli. What are some drawbacks to this approach? Is it possible to account for which logs have already been uploaded to S3?

Thanks for any help in advance.

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [June 14, 2022, 7:22pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/2 "2022-06-14T19:22:45Z")

</div>

Can you provide more context? It is not clear what you want to do and how this relate to the elastic stack.

If you want to send logs to AWS S3 using the aws cli tool, you should direct your question to a aws forum as there is no relation to elastic products.

---

<div class="post-metadata">

### Author: ![lhmzhou](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lhmzhou/32/83581_2.png) [@lhmzhou](https://discuss.elastic.co/u/lhmzhou)
#### Post date: [June 14, 2022, 7:50pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/3 "2022-06-14T19:50:05Z")

</div>

I might have bulldozed through the question. I'm looking to implement an S3 AWS storage option for ES cluster. Any insights to the pros/cons of using S3 as a storage option for an ELK stack? Does it depend on data load?

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [June 14, 2022, 11:06pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/4 "2022-06-14T23:06:31Z")

</div>

> [@lhmzhou](#):
>
> I'm looking to implement an S3 AWS storage option for ES cluster.

This is not supported, you can only use S3 storage for snapshots.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [June 14, 2022, 11:06pm UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/5 "2022-06-14T23:06:34Z")

</div>

The only way you can use s3 for Elasticsearch storage is either searchable snapshots, or snapshots (which cannot be searched).

---

<div class="post-metadata">

### Author: ![lhmzhou](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lhmzhou/32/83581_2.png) [@lhmzhou](https://discuss.elastic.co/u/lhmzhou)
#### Post date: [June 24, 2022, 11:28am UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/6 "2022-06-24T11:28:50Z")

</div>

Ah ok, thanks for that enlightenment.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 22, 2022, 11:29am UTC](https://discuss.elastic.co/t/logstash-pipeline-currently-forwarding-logs-to-elasticsearch/307197/7 "2022-07-22T11:29:39Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
