Dashboard Timeout - Data might be incomplete because your request timed out

Elastic Stack Kibana
1

Hi Team,

I am getting timeout error "Data might be incomplete because your request timed out" while retrieving 12.5GB of data in Kibana dashboard.
timeout increased from 30000 to "elasticsearch.requestTimeout: 90000" .
Please suggest if i need to tune any other parameters .

System Memory Details.

MemTotal: 32892852 kB
MemFree: 4041332 kB
MemAvailable: 11423120 kB
Buffers: 275688 kB
Cached: 7365620 kB
SwapCached: 41288 kB
Active: 5699920 kB
Inactive: 4164440 kB
Active(anon): 2142368 kB
Inactive(anon): 750992 kB
Active(file): 3557552 kB
Inactive(file): 3413448 kB
Unevictable: 17697984 kB
Mlocked: 17697984 kB
SwapTotal: 4194300 kB
SwapFree: 3381500 kB

2

@jbudz I think the data size here too much for Kibana to handle?

Thanks
Bhavya

3

Hi Bhavya, I don't think so, i belive some parameter have to tune...i tried increasing memory and also enabled below two options but still getting the same error.
elasticsearch.requestTimeout: 90000
elasticsearch.shardTimeout: 60000

4

Hey - those are the correct options for increasing the wait time. They'll work up to a maximum of two minutes. Beyond that we usually start looking into why the queries are taking so long and what we can optimize. Some of the parameters you're thinking of include:

  • number of visualizations in the dashboard
  • chart intervals (the more data points, the more load)
  • cluster load. how's the hardware on the cluster looking?
  • shard settings for the indices you're querying? too many shards and we'll see slow queries

I'd +1 @bhavyarm - 12.5gb is a lot to handle. It's going to cause significant strain on the browser that has to load all of this in memory, so less data would be ideal in addition any optimizations we can do.

5

Thanks Jon. I just added below parameter and also increased the RAM. So far no timeout occurred.

  1. elasticsearch.shardTimeout: 30000
    2 . Xms24g -Xmx24g" [Recommendation is 30G-will increase more in the future.]
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.