The number of indexes is increasing day by day, and the kibana dashboard shows that indexes are getting slower and slower

Elastic Stack Kibana
1

elastic search version：7.5.1
kibana：7.5.1

3 master roles, 3 data roles, 6 nodes in total.
It takes a few minutes to query the index, this is the fragmentation state.

GET _cluster/health
{
   "cluster_name": "elasticsearch",
   "status": "green",
   "timed_out": false,
   "number_of_nodes": 6,
   "number_of_data_nodes": 3,
   "active_primary_shards": 8806,
   "active_shards": 17427,
   "relocating_shards": 1,
   "initializing_shards": 0,
   "unassigned_shards": 0,
   "delayed_unassigned_shards": 0,
   "number_of_pending_tasks": 1,
   "number_of_in_flight_fetch": 0,
   "task_max_waiting_in_queue_millis": 0,
   "active_shards_percent_as_number": 100.0
}

image
image1817×880 63.2 KB

image
image1817×880 42.9 KB

Are there any optimization suggestions that can make the query faster.

2

That is why, you need to massively reduce the number of shards you have.

7.5 is EOL, please upgrade :slight_smile:

3

Thank you for your reply. My elasticsearch stores all the company's logs. The index is created every day and needs to be kept for a certain period of time. Lead to too many shards. I need to ask for some help here, or upgrade to 7.14. Will there be a higher performance improvement?

4

For example, some parameter settings

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.