# Elastic Search Logstash input -\>output AWS s3

**URL:** <https://discuss.elastic.co/t/elastic-search-logstash-input-output-aws-s3/302376>\
**Category:** Logstash\
**Created:** [April 13, 2022, 7:35pm UTC](https://discuss.elastic.co/t/elastic-search-logstash-input-output-aws-s3/302376 "2022-04-13T19:35:14Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![MLsuper](https://avatars.discourse-cdn.com/v4/letter/m/dfb087/32.png) [@MLsuper](https://discuss.elastic.co/u/MLsuper)\
**Post date:** [April 13, 2022, 7:35pm UTC](https://discuss.elastic.co/t/elastic-search-logstash-input-output-aws-s3/302376/1 "2022-04-13T19:35:14Z")

</div>

Is it possible not to query all the data(duplication) when we ingest data from Elasticsearch input -\>aws s3 output?

I want to ingest the data daily but it would duplicate it querying all the data from the start again but I want to ingest the data daily from the latest point so it would keep ingesting data daily

Here is the current query for logstash input

> query =\> '{ "query": {  
> "match\_all": {}  
> }}'

thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 11, 2022, 7:35pm UTC](https://discuss.elastic.co/t/elastic-search-logstash-input-output-aws-s3/302376/2 "2022-05-11T19:35:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.