Hi, I've been reading as much as I can, but I am still lost to a couple of terms and their interaction/difference:
Scroll -> I don't understand this concept and how it interacts with size
size (for an ES input for example) -- If I set a size of 50, how does a scroll of 10s affect that? It will take 10s to go through those results? It will wait 10s before calling ES again? Is it a case of which ever happens first?
Then it adds confusion for me for the pipeline.batch size. When I start logstash and I set the pipeline.batch size to 500, size to 50 and scrolling to 10s, what takes precedence?
I would love to be able to know how to actually manipulate these variables without just arbitrarily choosing. Any guidelines? I've looked all over and I feel like I am just as lost as when I started this quest