Kibana saved objects create api is taking for ever, cluster tasks pending for a long time

Hi Team,

Kibana saved objects create api is taking forever, cluster tasks are pending for a long time.
I am trying to create search, visualization, dashboards using kibana saved objects api.
observed that it is dead slow and response time of the kibana node goes very high.
I did tcp tuning from OS end and dont see any issues there.
The heap usage is normal on all the cluster nodes.
I am running with ELK 6.8 version.
cluster status is always "green".

cluster pending tasks list goes high. The kibana node response time shows high in monitoring.

"number_of_pending_tasks" : 69
"task_max_waiting_in_queue_millis" : 29914

When I checked the pending tasks it is showing the below entries taking long time.
"source" : "create-index-template [kibana_index_template:.kibana], cause [api]"

Please advise how can I tune this and speed up the cluster tasks execution of object creation.

What is the output from the _cluster/stats?pretty&human API in Elasticsearch?

Apologies, I could not send the cluster stats whole output, But please let me know if you need specific info, I can provide.
I have found the below task is showing long pending which is causing issue.
please advise
"insert_order" : 2770864,
"priority" : "HIGH",
"source" : "cluster_reroute(async_shard_fetch)",
"executing" : false,
"time_in_queue_millis" : 65907004,
"time_in_queue" : "18.3h"

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.