# Apm-server disconnections after upgrading to 7.10 **URL:** \ **Category:** APM\ **Tags:** server\ **Created:** [December 4, 2020, 12:40pm UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653 "2020-12-04T12:40:38Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![moixcruz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moixcruz/32/40464_2.png) [@moixcruz](https://discuss.elastic.co/u/moixcruz)\ **Post date:** [December 4, 2020, 12:40pm UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/1 "2020-12-04T12:40:39Z")
**Kibana version** : 7.5.1 - Elasticsearch version: 7.5.1 - APM Server version: 7.10.0 - APM Agent language and version: java and rum - Original install method (e.g. download page, yum, deb, from source, etc.) and version: yum - Fresh install or upgraded from other version? apm upgraded from 7.5.1 to 7.10.0 - Is there anything special in your setup? we use logstash in between apm-servers and elasticsearch for cache and pipelines such as user agent or geolocation - Description of the problem including expected versus actual behavior.: I'm upgrading the apm stack from 7.5.1 to latest 7.10.0. Recently I upgraded first the apm-server(s) and logstash(s), next iteration we will upgrade elasticsearch and kibana. Everything look continue working fine but since upgrade I see that apm connections on :8200 are dropping frequently, see screenshot with behavior before/after the upgrade (upgrade done on 8:00 of 2 Dec, a few hours later connections are reset every few minutes): Rest is working fine and I don't see errors indicating something bad, Is there anything I could check to see what is causing it? is it normal continues reset of connections since recent versions maybe? Thanks in advance! ---
**Author:** ![simitt](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/simitt/32/106406_2.png) [@simitt](https://discuss.elastic.co/u/simitt)\ **Post date:** [December 4, 2020, 1:43pm UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/2 "2020-12-04T13:43:17Z")
Hi @moixcruz, the change in behavior is not expected for recent APM Server version upgrades. Could you maybe provide some more details: - which agent versions are you using and have you also updated them around the same time; if yes from which versions? - can the behavior be observed for connections from the java and the RUM agent? - do you see any errors or logs in the agents indicating any issues? ---
**Author:** ![moixcruz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moixcruz/32/40464_2.png) [@moixcruz](https://discuss.elastic.co/u/moixcruz)\ **Post date:** [December 4, 2020, 8:54pm UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/3 "2020-12-04T20:54:23Z")
Thanks @simitt for your fast response - we have a wide variety of agents connected, java (I see versions from 1.9.0 to 1.16.0 connected), dotnet (1.5.1) and js/rum as well (4.4.4, 4.9.1 and 5.0.0). I maintain the backend of elastic apm and other teams are responsible of agents in product, so unfortunately this is something I cannot control. - I don't see anything wrong from agents, checked connections and logs - I can't see anything weird in agents. As said I have no access to them but I've asked for logs of some random agents and cannot see anything weird on them indicating recurrent disconnections ---
**Author:** ![simitt](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/simitt/32/106406_2.png) [@simitt](https://discuss.elastic.co/u/simitt)\ **Post date:** [December 9, 2020, 8:42am UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/4 "2020-12-09T08:42:35Z")
Can you please also check the APM Server logs? In case some issue exists between APM Server and logstash, the internal memory queue might fill up resulting in a `503` response from the APM Server. In this case an error is immediately returned to the agents and a new connection would be created. Although I would expect this to also show up in agent logs, might be worth checking. ---
**Author:** ![moixcruz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/moixcruz/32/40464_2.png) [@moixcruz](https://discuss.elastic.co/u/moixcruz)\ **Post date:** [December 22, 2020, 11:26am UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/5 "2020-12-22T11:26:44Z")
Hi @simitt sorry for not answering before, I had some days off without access to the servers. I can't find 503 in logs, however I can now see that the behavior of the tcp connections is now better since some days 😳 see last 30 days where we see it fixed gradually several days after I opened this thread: ![Screenshot from 2020-12-22 11-50-01](https://us1.discourse-cdn.com/elastic/original/3X/8/5/8545f618b55e4444db5048e79ebce1be599a5a86.jpeg) Could be caused by a network issue but very weird that it started happening exactly right after the upgrade I will try asking network guys if there were something that could explain it, in any case thanks a lot for your help. I'll comment back with my findings ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 12, 2021, 7:27am UTC](https://discuss.elastic.co/t/apm-server-disconnections-after-upgrading-to-7-10/257653/6 "2021-01-12T07:27:14Z")
This topic was automatically closed 20 days after the last reply. New replies are no longer allowed.