I've the refresh_interval to 1s and it still doesn't seem to fix it.
Additional notes:
the start_time
for the realtime-log
query doesn't change unless the query came back with a success log because start_time
gets updated as so
current_starting_time = start_time
while True:
logs = make_query(..., start_time=current_starting_timestamp)
has_new_logs = logs.get("hits", {}).get("hits") and len(logs["hits"]["hits"]) > 0
if has_new_logs:
# Update the current starting timestamp for next query (already sorted)
current_starting_timestamp = logs["hits"]["hits"][0]["_source"]["@timestamp"]
await asyncio.sleep(2)
from this, we know that when it makes the query again, it still misses first log after the initial start_time