Long delay between indexing a document and its availability in search results

Hi, David!

I measure a delay after a response from index operation and until a document is visible. Here is the script that I use: https://gist.github.com/rmihael/4f37bce239c9265ec69f2dc695ffd405. Measurement is performed in measure_single_document function.
Typical output looks like this:

   Value     Percentile TotalCount 1/(1-Percentile)

   215.0 0.000000000000          1           1.00
   831.0 0.100000000000       1044           1.11
  1279.0 0.190000000000       2027           1.23
  1663.0 0.271000000000       2807           1.37
  1983.0 0.343900000000       3486           1.52
  2431.0 0.409510000000       4343           1.69
  2687.0 0.468559000000       4792           1.88
  2943.0 0.521703100000       5238           2.09
  3327.0 0.569532790000       5876           2.32
  3583.0 0.612579511000       6304           2.58
  3839.0 0.651321559900       6649           2.87
  4095.0 0.686189403910       7002           3.19
  4351.0 0.717570463519       7355           3.54
  4607.0 0.745813417167       7655           3.93
  4863.0 0.771232075450       7973           4.37
  4863.0 0.794108867905       7973           4.86
  5119.0 0.814697981115       8238           5.40
  5375.0 0.833228183003       8495           6.00
  5631.0 0.849905364703       8731           6.66
  5631.0 0.864914828233       8731           7.40
  5887.0 0.878423345409       8943           8.23
  5887.0 0.890581010868       8943           9.14
  6143.0 0.901522909782       9125          10.15
  6143.0 0.911370618803       9125          11.28
  6399.0 0.920233556923       9290          12.54
  6399.0 0.928210201231       9290          13.93
  6655.0 0.935389181108       9450          15.48
  6655.0 0.941850262997       9450          17.20
  6911.0 0.947665236697       9576          19.11
  6911.0 0.952898713028       9576          21.23
  7167.0 0.957608841725       9686          23.59
  7167.0 0.961847957552       9686          26.21
  7167.0 0.965663161797       9686          29.12
  7423.0 0.969096845617       9769          32.36
  7423.0 0.972187161056       9769          35.95
  7423.0 0.974968444950       9769          39.95
  7679.0 0.977471600455       9842          44.39
  7679.0 0.979724440410       9842          49.32
  7679.0 0.981751996369       9842          54.80
  7679.0 0.983576796732       9842          60.89
  7935.0 0.985219117059       9904          67.65
  7935.0 0.986697205353       9904          75.17
  7935.0 0.988027484817       9904          83.52
  7935.0 0.989224736336       9904          92.81
  7935.0 0.990302262702       9904         103.12
  8191.0 0.991272036432       9950         114.57
  8191.0 0.992144832789       9950         127.30
  8191.0 0.992930349510       9950         141.45
  8191.0 0.993637314559       9950         157.17
  8191.0 0.994273583103       9950         174.63
  8191.0 0.994846224793       9950         194.03
  8703.0 0.995361602313       9998         215.59
  8703.0 0.995825442082       9998         239.55
  8703.0 0.996242897874       9998         266.16
  8703.0 0.996618608086       9998         295.74
  8703.0 0.996956747278       9998         328.60
  8703.0 0.997261072550       9998         365.11
  8703.0 0.997534965295       9998         405.67
  8703.0 0.997781468766       9998         450.75
  8703.0 0.998003321889       9998         500.83
  8703.0 0.998202989700       9998         556.48
  8703.0 0.998382690730       9998         618.31
  8703.0 0.998544421657       9998         687.01
  8703.0 0.998689979491       9998         763.35
  8703.0 0.998820981542       9998         848.16
  8703.0 0.998938883388       9998         942.40
  8703.0 0.999044995049       9998        1047.11
  8703.0 0.999140495544       9998        1163.46
  8703.0 0.999226445990       9998        1292.73
  8703.0 0.999303801391       9998        1436.37
  8703.0 0.999373421252       9998        1595.97
  8703.0 0.999436079127       9998        1773.30
  8703.0 0.999492471214       9998        1970.33
  8703.0 0.999543224093       9998        2189.26
  8703.0 0.999588901683       9998        2432.51
  8703.0 0.999630011515       9998        2702.79
  8703.0 0.999667010363       9998        3003.10
  8703.0 0.999700309327       9998        3336.77
  8703.0 0.999730278394       9998        3707.53
  8703.0 0.999757250555       9998        4119.47
  8703.0 0.999781525499       9998        4577.19
  9215.0 0.999803372950      10000        5085.77
  9215.0 1.000000000000      10000
#[Mean    =       3129.2, StdDeviation   =       1932.5]
#[Max     =       9215.0, TotalCount     =      10000.0]
#[Buckets =           18, SubBuckets     =           32]