# What data is being queried when there is a continuous stream of input data?

**URL:** <https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149>\
**Category:** Elasticsearch\
**Created:** [March 20, 2019, 1:19pm UTC](https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149 "2019-03-20T13:19:50Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![yishain11](https://avatars.discourse-cdn.com/v4/letter/y/df705f/32.png) [@yishain11](https://discuss.elastic.co/u/yishain11)\
**Post date:** [March 20, 2019, 1:19pm UTC](https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149/1 "2019-03-20T13:19:50Z")

</div>

Hi, sorry if this is a basic question, but here goes:  
Lets say I have continuous stream of data being pushed into an elasticsearch index. When I'm sending a query, to what data does the query apply to? If relevant data is being added into the index while the query is being proceesed, will it be included in the final results?  
I would love to see some docs on the subject, on how the low level stuff works regarding this question.  
Thanks!

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [March 20, 2019, 1:30pm UTC](https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149/2 "2019-03-20T13:30:38Z")

</div>

Hey,

the topic to read about is called `refresh`. By default there is a process in the background that runs once per second (this duration is called the refresh interval) which ensures that data indexed up to that point is made available for search.

See [https://www.elastic.co/guide/en/elasticsearch/reference/6.6/docs-refresh.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/docs-refresh.html) (you might also be interested how lucene stores its data, and how those are made available for search)

Couple of optional links

[https://www.elastic.co/guide/en/elasticsearch/reference/6.6/indices-flush.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/indices-flush.html)  
[https://www.elastic.co/guide/en/elasticsearch/reference/6.6/index-modules-translog.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/index-modules-translog.html)  
[https://www.elastic.co/guide/en/elasticsearch/reference/6.6/index-modules-merge.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/index-modules-merge.html)  
[https://www.elastic.co/guide/en/elasticsearch/guide/current/inside-a-shard.html](https://www.elastic.co/guide/en/elasticsearch/guide/current/inside-a-shard.html)

--Alex

---

<div class="post-metadata">

**Author:** ![yishain11](https://avatars.discourse-cdn.com/v4/letter/y/df705f/32.png) [@yishain11](https://discuss.elastic.co/u/yishain11)\
**Post date:** [March 24, 2019, 7:31am UTC](https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149/3 "2019-03-24T07:31:09Z")

</div>

Thanks Alex! That is realy helpful.  
Cheers

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 21, 2019, 7:31am UTC](https://discuss.elastic.co/t/what-data-is-being-queried-when-there-is-a-continuous-stream-of-input-data/173149/4 "2019-04-21T07:31:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.