Kibana can not login 
When I deployed the es cluster and kibana using Elastic Cloud on Kubernetes, the cluster was deployed successfully and in good health, but kibana could not log in. The error log was as follows:
|Tue, Apr 18 2023 9:59:12 am|[2023-04-18T01:59:12.247+00:00][INFO ][plugins.security.routes] Logging in with provider "basic" (basic)|
| --- | --- |
|Tue, Apr 18 2023 9:59:18 am|[2023-04-18T01:59:18.960+00:00][ERROR][plugins.security.authorization] Error registering Kibana Privileges with Elasticsearch for kibana-.kibana: Request timed out|
|Tue, Apr 18 2023 9:59:28 am|[2023-04-18T01:59:28.475+00:00][ERROR][plugins.taskManager] Failed to poll for work: Error: work has timed out|
|Tue, Apr 18 2023 9:59:28 am|[2023-04-18T01:59:28.604+00:00][INFO ][status] Kibana is now degraded (was available)|
|Tue, Apr 18 2023 9:59:34 am|[2023-04-18T01:59:34.586+00:00][INFO ][status] Kibana is now available (was degraded)|
|Tue, Apr 18 2023 9:59:57 am|[2023-04-18T01:59:57.825+00:00][INFO ][status] Kibana is now degraded (was available)|
|Tue, Apr 18 2023 10:00:09 am|[2023-04-18T02:00:09.926+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:00:09 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:00:09 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:00:09 am|at runNextTicks (node:internal/process/task_queues:65:3)|
|Tue, Apr 18 2023 10:00:09 am|at listOnTimeout (node:internal/timers:528:9)|
|Tue, Apr 18 2023 10:00:09 am|at processTimers (node:internal/timers:502:7)|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:00:09 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:00:09 am|[2023-04-18T02:00:09.930+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:00:09 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:00:09 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:00:09 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:00:09 am|[2023-04-18T02:00:09.965+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:00:09 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:00:09 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:00:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:00:09 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:00:16 am|[2023-04-18T02:00:16.588+00:00][INFO ][status] Kibana is now available (was degraded)|
|Tue, Apr 18 2023 10:00:18 am|[2023-04-18T02:00:18.535+00:00][ERROR][plugins.security.user-profile] Failed to activate user profile (retries left: 9): {"error":{"root_cause":[{"type":"version_conflict_engine_exception","reason":"[profile_u_mGBROF_q5bmFCATbLXAcCwKa0k8JvONAwSruelyKA5E_0]: version conflict, required seqNo [13], primary term [1]. current document has seqNo [14] and primary term [1]","index_uuid":"TEVsxL-KSdasKY2g6Z_6rw","shard":"0","index":".security-profile-8"}],"type":"version_conflict_engine_exception","reason":"[profile_u_mGBROF_q5bmFCATbLXAcCwKa0k8JvONAwSruelyKA5E_0]: version conflict, required seqNo [13], primary term [1]. current document has seqNo [14] and primary term [1]","index_uuid":"TEVsxL-KSdasKY2g6Z_6rw","shard":"0","index":".security-profile-8"},"status":409}.|
|Tue, Apr 18 2023 10:00:48 am|[2023-04-18T02:00:48.141+00:00][ERROR][plugins.security.session.index] Failed to create session value: version_conflict_engine_exception|
|Tue, Apr 18 2023 10:00:48 am|Root causes:|
|Tue, Apr 18 2023 10:00:48 am|version_conflict_engine_exception: [58hOJcqmT6/ZwEyf7AWR4H/DFbcIHSkEawz1ESE+/84=]: version conflict, document already exists (current version [1])|
|Tue, Apr 18 2023 10:00:48 am|[2023-04-18T02:00:48.142+00:00][ERROR][http] ResponseError: version_conflict_engine_exception|
|Tue, Apr 18 2023 10:00:48 am|Root causes:|
|Tue, Apr 18 2023 10:00:48 am|version_conflict_engine_exception: [58hOJcqmT6/ZwEyf7AWR4H/DFbcIHSkEawz1ESE+/84=]: version conflict, document already exists (current version [1])|
|Tue, Apr 18 2023 10:00:48 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:479:27)|
|Tue, Apr 18 2023 10:00:48 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:00:48 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:00:48 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:00:48 am|at ClientTraced.CreateApi [as create] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/create.js:43:12)|
|Tue, Apr 18 2023 10:00:48 am|at SessionIndex.writeNewSessionDocument (/usr/share/kibana/x-pack/plugins/security/server/session_management/session_index.js:655:9)|
|Tue, Apr 18 2023 10:00:48 am|at SessionIndex.create (/usr/share/kibana/x-pack/plugins/security/server/session_management/session_index.js:194:11)|
|Tue, Apr 18 2023 10:00:48 am|at Session.create (/usr/share/kibana/x-pack/plugins/security/server/session_management/session.js:163:31)|
|Tue, Apr 18 2023 10:00:48 am|at Authenticator.updateSessionValue (/usr/share/kibana/x-pack/plugins/security/server/authentication/authenticator.js:597:25)|
|Tue, Apr 18 2023 10:00:48 am|at Authenticator.login (/usr/share/kibana/x-pack/plugins/security/server/authentication/authenticator.js:196:37)|
|Tue, Apr 18 2023 10:00:48 am|at /usr/share/kibana/x-pack/plugins/security/server/routes/authentication/common.js:137:34|
|Tue, Apr 18 2023 10:00:48 am|at Router.handle (/usr/share/kibana/node_modules/@kbn/core-http-router-server-internal/src/router.js:141:30)|
|Tue, Apr 18 2023 10:00:48 am|at handler (/usr/share/kibana/node_modules/@kbn/core-http-router-server-internal/src/router.js:107:50)|
|Tue, Apr 18 2023 10:00:48 am|at exports.Manager.execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/toolkit.js:60:28)|
|Tue, Apr 18 2023 10:00:48 am|at Object.internals.handler (/usr/share/kibana/node_modules/@hapi/hapi/lib/handler.js:46:20)|
|Tue, Apr 18 2023 10:00:48 am|at exports.execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/handler.js:31:20)|
|Tue, Apr 18 2023 10:00:48 am|at Request._lifecycle (/usr/share/kibana/node_modules/@hapi/hapi/lib/request.js:371:32)|
|Tue, Apr 18 2023 10:00:48 am|at Request._execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/request.js:281:9)|
|Tue, Apr 18 2023 10:01:09 am|[2023-04-18T02:01:09.987+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:01:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:01:09 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:01:09 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:01:09 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:01:09 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:01:10 am|[2023-04-18T02:01:10.004+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:01:10 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:01:10 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:01:10 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:01:10 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:01:10 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:01:20 am|[2023-04-18T02:01:20.988+00:00][ERROR][plugins.security.authorization] Error registering Kibana Privileges with Elasticsearch for kibana-.kibana: Request timed out|
|Tue, Apr 18 2023 10:02:10 am|[2023-04-18T02:02:10.021+00:00][WARN ][plugins.usageCollection.usage-collection.usage-counters-service] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:02:10 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:02:10 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:02:10 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:02:10 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:02:10 am|at ClientTraced.UpdateApi [as update] (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/update.js:50:12)|
|Tue, Apr 18 2023 10:02:18 am|[2023-04-18T02:02:18.696+00:00][ERROR][plugins.security.user-profile] Failed to activate user profile: Request timed out.|
|Tue, Apr 18 2023 10:02:18 am|[2023-04-18T02:02:18.697+00:00][ERROR][http] TimeoutError: Request timed out|
|Tue, Apr 18 2023 10:02:18 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:527:31)|
|Tue, Apr 18 2023 10:02:18 am|at runMicrotasks (<anonymous>)|
|Tue, Apr 18 2023 10:02:18 am|at processTicksAndRejections (node:internal/process/task_queues:96:5)|
|Tue, Apr 18 2023 10:02:18 am|at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/src/create_transport.js:51:16)|
|Tue, Apr 18 2023 10:02:18 am|at Security.activateUserProfile (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/security.js:60:16)|
|Tue, Apr 18 2023 10:02:18 am|at UserProfileService.activate (/usr/share/kibana/x-pack/plugins/security/server/user_profile/user_profile_service.js:111:26)|
|Tue, Apr 18 2023 10:02:18 am|at Authenticator.updateSessionValue (/usr/share/kibana/x-pack/plugins/security/server/authentication/authenticator.js:588:24)|
|Tue, Apr 18 2023 10:02:18 am|at Authenticator.login (/usr/share/kibana/x-pack/plugins/security/server/authentication/authenticator.js:196:37)|
|Tue, Apr 18 2023 10:02:18 am|at /usr/share/kibana/x-pack/plugins/security/server/routes/authentication/common.js:137:34|
|Tue, Apr 18 2023 10:02:18 am|at Router.handle (/usr/share/kibana/node_modules/@kbn/core-http-router-server-internal/src/router.js:141:30)|
|Tue, Apr 18 2023 10:02:18 am|at handler (/usr/share/kibana/node_modules/@kbn/core-http-router-server-internal/src/router.js:107:50)|
|Tue, Apr 18 2023 10:02:18 am|at exports.Manager.execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/toolkit.js:60:28)|
|Tue, Apr 18 2023 10:02:18 am|at Object.internals.handler (/usr/share/kibana/node_modules/@hapi/hapi/lib/handler.js:46:20)|
|Tue, Apr 18 2023 10:02:18 am|at exports.execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/handler.js:31:20)|
|Tue, Apr 18 2023 10:02:18 am|at Request._lifecycle (/usr/share/kibana/node_modules/@hapi/hapi/lib/request.js:371:32)|
|Tue, Apr 18 2023 10:02:18 am|at Request._execute (/usr/share/kibana/node_modules/@hapi/hapi/lib/request.js:281:9)|
|Tue, Apr 18 2023 10:02:25 am|[2023-04-18T02:02:25.494+00:00][ERROR][plugins.taskManager] Failed to poll for work: Error: work has timed out|
|Tue, Apr 18 2023 10:02:25 am|[2023-04-18T02:02:25.621+00:00][INFO ][status] Kibana is now degraded (was available)|
|Tue, Apr 18 2023 10:02:31 am|[2023-04-18T02:02:31.612+00:00][INFO ][status] Kibana is now available (was degraded|