During my task to compare performance between dockerized elasticsearch and running elasticsearch as native service / on shell, I discovered big fluctuation between the tests - when rerunning the same testset!
First I compared the overall time of the run:
so we van see about 4 minutes difference in overall time.
I digged deeper to see which operation is causing this:
There are a few operations which are slower, but painless_static is the negative winner.
Above we see throughput, latency and service time. The second run is much slower.
But I am not able to find anything suspcios in metricbeat dashboards:
see 12:24 - 12:28 and compare with 13:02 - 13:09
Here is my testing process:
- delete old geonames-index via kibana
- stop elasticsearch
- stop kibana
- start elasticsearch
- start kibana
- wait until elasticsearch is up
- run esrally with external car, track geonames, challenge default.
Nothing else is running on the server where elasticsearch is tested (except for metricbeat).
esrally runs on a system shared with elastic dev system with very low load. But I also stopped that dev system in previous runs, where the benchmarks had the same fluctuation.
Any help is really appreciated.
Thanks a lot, Andreas