last time I tried to upgrade my productive ES instance from 5.1.2 to 6.1.0 I got performance issues afterwards.
Before running the next rollout, I would like to do some loadtests before to be sure that changes during my migration / integration do nothing bad.
I got the hint to use rally and here I am.
I would like to test as near to reality as possible by spending as few time as possible for that
We are indexing log files, splitting it to fields and we have multiple extensive dashboards which are visualized via kibana.
Is the assumption correct, that the kind of data (number of indexes, number of docs per index, number of shards, number of fields per index, number of fields per type and of course the user queries (via kibana)) are (significantly) effecting the speed of my node / cluster?
If so, I assume I need to build my own track.
- is it possible to export productive data and use it as document input for rally? How?
- How do I deal with the user queries? Is there an easy way to take the queries e.g. from kibana logs and provide them as challenge? How?
In the meantime I will continue reading the docs (I am not completely through yet) and will get warm with the default tracks.