I want to evaluate the impact of running elasticsearch as docker container instead of a classic / native installation. So I wanted to run and compare the external car of docker container and classic installation we have and I want to race on geonames, http logs and eventdata tracks.
Also I want to run each race three times and average the values, because in the first two iteration I had differences on indexing time and 50% percentiles of about 3-4% in same testset and on large_filtered_terms I have differences of about 12% between two runs.
I am a bit curious why I have such big differences. Nevertheless I wanted to workaround these by building some average of the results and comparing avg of docker vs avg of native installation.
Before accidently reinventing the wheel I just wanted to ask:
Is there any out of the box way to send the results to a separate elasticsearch instance to access the result data via kibana?
are there any prebuild dashboards?
Is there already a function to compare a baseline to more than one contender? Not racing one on one, just with a full race grid
Is there already a function to calculate the average result of multiple racers?
What experience do you have about differences in the results when rerunning the test? Is 12% normal?
Thanks a lot,