How to solve this error in kibana?

[Yungyoung_Ok (ooyy)]

Discover found the error.
Looking at the kibana and elasticsearch logs, there are no errors.
What is the cause and how to fix it?

[Roshan_Jha]

Hi, whenever some error is shown in kibana discovery it gives error in background, please check and how you are running kibana service, if possible please paste kibana query which you are running in discovery.

[Yungyoung_Ok (ooyy)]

Here is query in inspect of discover.

    {
  "version": true,
  "size": 500,
  "sort": [
    {
      "@timestamp": {
        "order": "desc",
        "unmapped_type": "boolean"
      }
    }
  ],
  "aggs": {
    "2": {
      "date_histogram": {
        "field": "@timestamp",
        "fixed_interval": "3h",
        "time_zone": "Asia/Seoul",
        "min_doc_count": 1
      }
    }
  },
  "stored_fields": [
    "*"
  ],
  "script_fields": {},
  "docvalue_fields": [
    {
      "field": "@kst_timestamp",
      "format": "date_time"
    },
    {
      "field": "@timestamp",
      "format": "date_time"
    },
    {
      "field": "object.@kst_event_start_timestamp",
      "format": "date_time"
    },
    {
      "field": "object.event_start_time",
      "format": "date_time"
    },
    {
      "field": "timestamp",
      "format": "date_time"
    }
  ],
  "_source": {
    "excludes": []
  },
  "query": {
    "bool": {
      "must": [],
      "filter": [
        {
          "match_all": {}
        },
        {
          "range": {
            "@timestamp": {
              "gte": "2020-04-18T15:00:00.000Z",
              "lte": "2020-04-25T14:59:59.999Z",
              "format": "strict_date_optional_time"
            }
          }
        }
      ],
      "should": [],
      "must_not": []
    }
  },
  "highlight": {
    "pre_tags": [
      "@kibana-highlighted-field@"
    ],
    "post_tags": [
      "@/kibana-highlighted-field@"
    ],
    "fields": {
      "*": {}
    },
    "fragment_size": 2147483647
  }
}

[Roshan_Jha]

Hi, tried the query which you provided it is not giving any error in my kibana discovery even though it is not providing any error which is obvious, is it working correctly in dev tools and if yes can you show the output.
Thanks

[Yungyoung_Ok (ooyy)]

The query works fine.
The above error does not occur continuously, but it occurs occasionally.

It doesn't seem to be a query problem, but I don't know where to look.

Often, bad gateway problems also occur.
So I set elasticsearch.requestTimeout and elasticsearch.shardTimeout to 3 minutes.

Looking at the stack monitoring, es and kibana both maintain the average speed within 2 seconds.
The kibana avg response is within 2 seconds and elastic search search latency is within 100 ms.

Nevertheless, there are often problems, which part should I look at?

The proxy is set in front of kibana, is it related to the timeout setting?

[Roshan_Jha]

The timeout you are setting is max because elastic will never take that much time to execute the query, atleast in your case. in case of your can you disable the proxy in front of kibana and what about the running the same query directly in elastic without using kibana ?.