# Intermittent proxy errors in Kibana 7.9.3 stack monitoring through Apache httpd

**URL:** <https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073>\
**Category:** Kibana\
**Created:** [November 2, 2020, 7:21pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073 "2020-11-02T19:21:20Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![retzkek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/retzkek/32/9732_2.png) [@retzkek](https://discuss.elastic.co/u/retzkek)\
**Post date:** [November 2, 2020, 7:21pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073/1 "2020-11-02T19:21:20Z")

</div>

We recently upgraded one of our clusters to 7.9.3 (from 6.8.12), and I'm now seeing frequent, but intermittent, proxy errors while in stack monitoring. For instance here is a screenshot of a minute or so in the monitoring overview:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/0/003e1ebc9c7d5063d998702296cd1f72dcc805f0.png)

Sample httpd log from a request:

```
[Mon Nov 02 18:23:03.907127 2020] [proxy_http:error] [pid 112] (104)Connection reset by peer: [client ...:55770] AH01102: error reading status line from remote server kibanamon:5601, referer: https://.../kibanamon/app/monitoring
[Mon Nov 02 18:23:03.907160 2020] [proxy:error] [pid 112] [client ...:55770] AH00898: Error reading from remote server returned by /kibanamon/api/monitoring/v1/alert/5Hic1QrdQTmZwzbEPNUFLw/status, referer:https://.../kibanamon/app/monitoring ... - kretzke
[02/Nov/2020:18:23:03 +0000] "POST /kibanamon/api/monitoring/v1/alert/5Hic1QrdQTmZwzbEPNUFLw/status HTTP/1.1"502 506 "https://.../kibanamon/app/monitoring" "Mozilla/5.0 (Macintosh;Intel Mac OS X 10.14; rv:82.0) Gecko/20100101 Firefox/82.0"0

```

There are no related messages in the kibana log with `logging.verbose:true`

Kibana and httpd (2.4.6) are running in Docker containers on the same host, under docker-compose. We didn't see any issues like this with Kibana 6.8.12, even on the same host through the same httpd proxy.

httpd is running a basic reverse proxy config:

```
ProxyPass /kibanamon http://kibanamon:5601
ProxyPassReverse /kibanamon http://kibanamon:5601
<location /kibanamon>
    AuthType Shibboleth
    [... auth settings]
</location>

```

Seems like a bug somewhere in the monitoring server, but I'm reaching out here first in case anyone has some ideas; maybe we need to make some changes to the proxy settings?

---

<div class="post-metadata">

**Author:** ![tsullivan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tsullivan/32/31077_2.png) [@tsullivan](https://discuss.elastic.co/u/tsullivan)\
**Post date:** [November 3, 2020, 6:41pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073/2 "2020-11-03T18:41:50Z")

</div>

I searched the interweb for `AH01102: error reading status line from remote server` and it seems to be an httpd message that can happen occasionally, especially if the back-end response takes a long time.

You can search for yourself, but the basic guidance that might apply to you is to try increasing the `Timeout` or `ProxyTimeout`

---

<div class="post-metadata">

**Author:** ![retzkek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/retzkek/32/9732_2.png) [@retzkek](https://discuss.elastic.co/u/retzkek)\
**Post date:** [November 3, 2020, 11:29pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073/3 "2020-11-03T23:29:24Z")

</div>

Thanks for the suggestions Tim. We don't have `ProxyTimeout` set, so afaik it will wait for the server to respond, and the global `TimeOut` is 900 seconds, so we're not hitting that. In any case, if the proxy server were closing the connection shouldn't Kibana log the failed request?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 1, 2020, 11:29pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073/4 "2020-12-01T23:29:30Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.