During Bulk Indexing, when the index.refresh_interval defaults to 1sec and RefreshPolicy set to NONE.
Query: In my case - Save Bulk Request runs in batches with 1k records in each batch. Out of 1k records, suppose 400 records are indexed in 1 sec and Indices are refreshed. Will the first 400 records be available for parallel search query (even though bulk transaction is not complete) ?
Additional Queries : What is the optimum setting for index refresh interval? Default is 1sec.
Is this good to go? Does it become a point of contention later when index size grows ?
What are the major aspect on deciding the index refresh interval?
In what all scenarios the default refresh interval of 1 sec can have an adverse impact?
Does this 1sec Vs 2sec Vs any interval has anything to do with the number of shards or replicas? Please suggest.