Read slow for large files in S3?

Elastic Stack Logstash
1

I have two files in a folder, one small 300kb, and one large, 2G. Logstash only reads 300kb one. Is it right? Shall i wait more time?

2

Is there any indication of network activity, suggesting that it's still working on the 2 GB file? If you bump up logging by starting Logstash with --debug, do the logs indicate that the download is even starting?

3

Thanks! It keeps saying:
Pushing flush onto pipeline {:level=>:debug, :file=>"logstash/pipeline.rb", :line=>"458", :method=>"flush"}

Does it mean it is downloading the file to my local ram?

4

S3 files are never downloaded into RAM. But no, that message isn't interesting.

5

Oh Sorry would you elaborate what does that message mean? what is being flushed into pipeline?