Running on Kibana and elastic 6.4
I know this is very similar to Kibana visualization is too slow but I would like to ask what can be done, what kind of strategy one might have.
We have several Tables in a single dashboard and all of them shows a count of something, often it is ipaddressen or some other value that we want to count how many we have in this timespan, but as our data grows these tables become very slow even when using smaller timespans.
So I have a dashboard with 3 tables, 1 metric, 2 time series and 1 horizontal bar, and the metric, horizontal bar and the two time series all load very fast (<1 sec during small timeframes like 1-4hours), but the 3 tables can take around 5seconds to load.
If we go up to "extrems", we have a dashboard with 6 tables, and when checking the last 30 days (even tho we only have data for about 10days), we often get the 30sec timeout, now we can make that timeout larger, but that does not solve the main problem with these tables being very slow.
What can we do to speed them up? We have them limited by giving them a filter to use, so they only use small parts of the logs, but they are still very slow.
We could do some pre-aggregation in some outside application, and use another index, but this creates problems with filtering.
Any suggestion is welcome!