Delete default index

gerardgorrion · June 30, 2022, 9:46am

Hi all, we have some indexes created by default in elasticsearch, managed by theese ILM:

For example, .alerts-ilm-policy have this index:

All in hot status:

When try to delete older index of these ilm, index deletion show a warning message:

Is possible to delete it? how can we manage this index lifecycle? we have more and more indices and soon we will reach the ES index limit.

Thanks and regards,

gerardgorrion · July 1, 2022, 10:27am

list of index created by system with this ilm, some with rollout:

index                                                         store.size
.monitoring-es-7-2022.06.29                                       27.8gb
.monitoring-es-7-2022.06.30                                       27.8gb
.monitoring-es-7-2022.06.28                                       27.4gb
.monitoring-es-7-2022.06.27                                       27.2gb
.monitoring-es-7-2022.07.01                                         13gb
.monitoring-logstash-7-2022.06.29                                  8.5gb
.monitoring-logstash-7-2022.06.30                                  8.5gb
.monitoring-logstash-7-2022.06.28                                  8.1gb
.monitoring-logstash-7-2022.06.27                                  7.5gb
.monitoring-logstash-7-2022.07.01                                  3.7gb
.kibana-event-log-7.16.2-000005                                      1gb
.kibana-event-log-7.16.2-000004                                  995.7mb
.kibana-event-log-7.16.2-000003                                  943.6mb
.kibana_7.16.2_001                                               362.7mb
.kibana_task_manager_7.16.2_001                                  252.9mb
.watches                                                         144.6mb
.kibana-event-log-7.16.2-000006                                    142mb
.watcher-history-13-2022.06.26                                    82.4mb
.watcher-history-13-2022.06.29                                    81.9mb
.watcher-history-13-2022.06.28                                    80.2mb
.watcher-history-13-2022.06.30                                    79.7mb
.watcher-history-13-2022.06.25                                    78.2mb
.watcher-history-13-2022.06.27                                    77.5mb
.ds-ilm-history-5-2022.03.21-000004                               49.5mb
.ds-ilm-history-5-2022.04.20-000006                               46.9mb
.ds-ilm-history-5-2022.05.20-000008                               43.6mb
.reporting-2022-05-15                                             32.4mb
.monitoring-kibana-7-2022.06.30                                   32.4mb
.watcher-history-13-2022.07.01                                    32.3mb
.monitoring-kibana-7-2022.06.29                                     30mb
.monitoring-kibana-7-2022.06.28                                   29.5mb
.monitoring-kibana-7-2022.06.27                                   29.5mb
.reporting-2021.09.12                                             25.5mb
.reporting-2021.12.12                                             18.4mb
.ds-ilm-history-5-2022.06.19-000010                               18.3mb
.reporting-2021.10.24                                               18mb
.monitoring-kibana-7-2022.07.01                                   17.4mb
.kibana_7.15.2_001                                                15.9mb
.reporting-2022-06-19                                             13.4mb
.reporting-2022-03-27                                             12.9mb
.triggered_watches                                                12.8mb
.reporting-2021.08.08                                             11.7mb
.reporting-2021.11.07                                             10.3mb
.reporting-2022-02-20                                             10.2mb
.reporting-2022-06-26                                              7.5mb
.reporting-2021.09.26                                                7mb
.reporting-2021.10.17                                              6.3mb
.reporting-2021.11.14                                              5.7mb
.kibana_1                                                            5mb
.reporting-2022-05-01                                              4.6mb
.reporting-2022-01-23                                              4.4mb
.reporting-2022-06-12                                              3.7mb
.reporting-2021.05.16                                              3.5mb
.internal.alerts-observability.metrics.alerts-default-000001       2.9mb
.async-search                                                      2.4mb
.kibana_security_session_1                                         1.8mb
.ds-.logs-deprecation.elasticsearch-default-2022.01.26-000001      1.4mb
.reporting-2020.10.11                                              1.3mb
.reporting-2021-12-26                                              1.1mb
.reporting-2022-04-24                                             1018kb
.reporting-2021.11.21                                            826.5kb
.kibana_task_manager_7.15.2_001                                  811.4kb
.internal.alerts-observability.metrics.alerts-default-000002     757.7kb
.slm-history-1-000002                                            672.2kb
.ds-.logs-deprecation.elasticsearch-default-2022.04.21-000007    625.6kb
.ds-.logs-deprecation.elasticsearch-default-2022.04.07-000006    615.3kb
.ds-.logs-deprecation.elasticsearch-default-2022.02.09-000002    585.5kb
.security-7                                                      575.4kb
.reporting-2022-04-03                                            542.2kb
.reporting-2021.11.28                                            496.6kb
.internal.alerts-observability.uptime.alerts-default-000003      484.9kb
.ds-.logs-deprecation.elasticsearch-default-2022.06.18-000011    479.8kb
.ds-.logs-deprecation.elasticsearch-default-2022.02.24-000003    436.4kb
.reporting-2021.10.31                                            431.3kb
.reporting-2022-04-10                                            388.6kb
.internal.alerts-observability.uptime.alerts-default-000004      359.7kb
.internal.alerts-observability.uptime.alerts-default-000005      335.7kb
.internal.alerts-observability.apm.alerts-default-000004         316.1kb
.internal.alerts-observability.uptime.alerts-default-000001      308.1kb
.ds-.logs-deprecation.elasticsearch-default-2022.05.06-000008    293.8kb
.internal.alerts-observability.logs.alerts-default-000001        293.1kb
.ds-.logs-deprecation.elasticsearch-default-2022.03.24-000005    262.3kb
.internal.alerts-observability.apm.alerts-default-000001         253.1kb
.internal.alerts-observability.uptime.alerts-default-000002      248.7kb
.tasks                                                           248.4kb
.internal.alerts-observability.logs.alerts-default-000004        235.3kb
.internal.alerts-observability.logs.alerts-default-000003          222kb
.ds-.logs-deprecation.elasticsearch-default-2022.03.10-000004    214.6kb
.ds-.logs-deprecation.elasticsearch-default-2022.06.04-000010    208.4kb
.ds-.slm-history-5-2022.04.20-000006                             183.2kb
.ds-.logs-deprecation.elasticsearch-default-2022.05.20-000009    178.7kb
.internal.alerts-observability.logs.alerts-default-000005        176.9kb
.reporting-2020.03.22                                              168kb
.ds-.slm-history-5-2022.03.21-000004                             165.9kb
.monitoring-alerts-7                                             160.3kb
.ds-.slm-history-5-2022.05.21-000008                             130.1kb
.ds-.slm-history-5-2022.06.20-000010                             126.3kb
.reporting-2022-02-06                                            114.5kb
.transform-notifications-000002                                    111kb
.reporting-2020.10.04                                            109.7kb
.internal.alerts-observability.apm.alerts-default-000005         106.3kb
.internal.alerts-observability.logs.alerts-default-000002         87.9kb
.kibana_task_manager_1                                            43.4kb
.fleet-policies-7                                                 41.6kb
.internal.alerts-observability.apm.alerts-default-000003            30kb
.internal.alerts-observability.apm.alerts-default-000002            30kb
.transform-internal-007                                           18.1kb
.fleet-enrollment-api-keys-7                                      13.4kb
.apm-agent-configuration                                            604b
.apm-custom-link                                                    558b
.siem-signals-default-000001                                        558b
.items-default-000001                                               558b
.lists-middleware-000001                                            558b
.siem-signals-middleware-000001                                     558b
.lists-default-000001                                               558b
.items-middleware-000001                                            558b
.reporting-2022-05-22                                               492b
.internal.alerts-observability.logs.alerts-default-000006           452b
.siem-signals-default-000002                                        452b
.siem-signals-default-000003                                        452b
.siem-signals-default-000004                                        452b
.kibana-event-log-7.15.2-000004                                     452b
.siem-signals-default-000005                                        452b
.siem-signals-default-000006                                        452b
.siem-signals-default-000007                                        452b
.kibana-event-log-7.15.2-000007                                     452b
.kibana-event-log-7.15.2-000006                                     452b
.kibana-event-log-7.15.2-000005                                     452b
.internal.alerts-observability.metrics.alerts-default-000004        452b
.internal.alerts-observability.metrics.alerts-default-000003        452b
.internal.alerts-observability.metrics.alerts-default-000005        452b
.siem-signals-service-000002                                        452b
.siem-signals-service-000003                                        452b
.siem-signals-service-000004                                        452b
.siem-signals-service-000005                                        452b
.siem-signals-service-000006                                        452b
.siem-signals-service-000007                                        452b
.siem-signals-service2-000002                                       452b
.siem-signals-service2-000001                                       452b

Can someone help me to identify unused indexes?

Thanks,

gerardgorrion · July 6, 2022, 7:20am

Some idea about this index and the deletion procedure reccomended?

Thanks,

system · August 3, 2022, 7:21am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
ILM Delete Only Phase Elasticsearch ilm-index-lifecycle-management	2	715	July 9, 2020
Elasticsearch ILM Deleting an index is just a logical drop, but the index can still be used. Will it eventually be physically deleted Elasticsearch ilm-index-lifecycle-management	17	632	July 15, 2021
These old indices should be deleted by ES according to ILM policy, right? Elasticsearch ilm-index-lifecycle-management	7	499	January 6, 2020
Strange index size Elasticsearch ilm-index-lifecycle-management , datastreams	15	2880	February 22, 2021
Index Lifecycle Management Elasticsearch ilm-index-lifecycle-management	3	304	January 16, 2023

Delete default index

Related topics