# Lifecycle policy

**URL:** <https://discuss.elastic.co/t/lifecycle-policy/186795>\
**Category:** Beats\
**Tags:** metricbeat\
**Created:** [June 21, 2019, 4:43am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795 "2019-06-21T04:43:21Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 4:43am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/1 "2019-06-21T04:43:21Z")

</div>

when first start metricbeat system

the lifecycle policy is made automatically  
i want to know how to make lifecycle policy in my setting not just automatically

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 5:47am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/2 "2019-06-21T05:47:52Z")

</div>

Hi @Min_Mah  
You got several options.

## modify

That what you have now is a Index life cycle management which gets configured and created with all what you need by metricbeat. It is possible to modify the created Lifecycle in Kibana. [manage created lifecycle](https://www.elastic.co/guide/en/kibana/current/index-lifecycle-policies.html)

## create

The full setup of ILM including lifecycle policies which has been done by metricbeat, can olso be done manually. That is under elasticsearch find [create ilm](https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started-index-lifecycle-management.html)

## just define your own policy

You can also let metricbeat setup everything the index lifecycle management, but define your own policy under a file: [json file for policy](https://www.elastic.co/guide/en/beats/metricbeat/7.1/ilm.html#setup-ilm-policy_file-option)

Let me know if this helped you =)

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 6:38am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/3 "2019-06-21T06:38:54Z")

</div>

can i ask something more??

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 6:50am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/4 "2019-06-21T06:50:18Z")

</div>

Yeah sure =)

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 7:04am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/5 "2019-06-21T07:04:34Z")

</div>

Thanks,  
i just change metricbeat index like this  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/c/4/c4735ce51b9abcb3dc3767f965cf800c07554403.png)

and now i have to setup dashboards to kibana  
so i type

> metricbeat setup

but dashboards follow default index

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/0/200ea138a6f7bf7f1e985f011d45bf3828adb1bc.png)

automatically make new index but it is default index name not mine.  
so i think i have to change more in metricbeat.yml  
so i tried this  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/b/2b8e508a82045956721df1a99b3ecdfbc06fa59b.png)

but.. it doesn't work for me

which point i have to change??

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 7:28am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/6 "2019-06-21T07:28:52Z")

</div>

Please try to paste config parts as string and not as image. It is easier for readers to copy parts out of it and find it via browser search =)

If you go on a dashboard, are they pointing to the indexpattern which you have set with `setup.dashboards.index` ?  
Did you create the "systeminfo-\*" index pattern in Kibana ? I think you have to set the id same as the indexpattern name.

Thank you for answering both questions.

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 7:48am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/7 "2019-06-21T07:48:53Z")

</div>

Thanks for reply.

in my metricbeat.yml only i was edit

> #============================== Kibana =====================================  
> setup.kibana:
> 
> host: "192.168.0.88:5601"  
> setup.dashboards.index: "systeminfo-\*"
> 
> #-------------------------- Elasticsearch output ------------------------------  
> output.elasticsearch:  
> hosts: ["192.168.0.88:9200"]
> 
> setup.ilm.enabled: auto  
> setup.ilm.rollover\_alias: "systeminfo"  
> setup.ilm.pattern: "000001"  
> setup.ilm.policy\_name: "SystemInfo"

yes i was create systeminfo-\* in kibana index pattern

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 7:57am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/8 "2019-06-21T07:57:50Z")

</div>

I think the dashboard is not working?  
Can you send me a printscrren of the error shown on dashbaord ?

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 8:02am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/9 "2019-06-21T08:02:18Z")

</div>

Okey!!  
Info -1. i have only 1 index

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/c/f/cf26dd9da7605ab14af5d819b6fdaf54868e0a13.png)  
Info -2. when i was type metricbeat setup - then kibana index automatically make (metricbeat-_)  
  ![image](https://us1.discourse-cdn.com/elastic/original/3X/6/4/6410bbe16bb4469426f235e5adc14f78c93ecb5c.png)   
Info -3.after setup dashboard follows index - metricbeat-_ not systeminfo-\*

this is dashboard screen

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/f/9/f90f43c95d14c5526573e866e06146571fd8b31c.png)

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 8:09am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/10 "2019-06-21T08:09:59Z")

</div>

they want to connect index-pattern -\> metricbeat-\*

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/8/2/82c581c8033e414ae999487622dab9a50bcc7e75.png)

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 8:18am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/11 "2019-06-21T08:18:22Z")

</div>

Ok you got actually 2 errors.

Your visualisations are also pointing to the old index. did you try deleting all visualisations and dashboards from metricbeat and runnning the `metricbeat setup --dashboards` ? because the setting `setup.dashboards.index`should be enough to point to the correct index-pattern

Then check if the index is pointed correctly. You would have need to create a new index-pattern in kibana which is pointing to systembeat-\* with systembeat-\* as id. You can provide a custom id during the index-pattern creation.

The other error which you have seems to be a permission error. If you still have that error then try this [discuss matter](https://discuss.elastic.co/t/kibana-the-aggregations-key-is-missing-from-the-response-error/147717)

Hope this helps

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 8:25am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/12 "2019-06-21T08:25:52Z")

</div>

I was delete all visualization and dashboards  
then metricbeat setup --dashboards but it doesnt' work..  
Thanks for helps

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 8:29am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/13 "2019-06-21T08:29:53Z")

</div>

can you provide the .yml file?  
(only not commented lines)

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 8:36am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/14 "2019-06-21T08:36:17Z")

</div>

only not commented thing is just this

> #========================== Modules configuration ============================  
> metricbeat.config.modules:  
> path: ${path.config}/modules.d/\*.yml
> 
> reload.enabled: false
> 
> #==================== Elasticsearch template setting ==========================  
> setup.template.settings:  
> index.number\_of\_shards: 1  
> index.codec: best\_compression
> 
> #================================ Processors =====================================
> 
> processors:
> 
> - add\_host\_metadata: ~
> - add\_cloud\_metadata: ~

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 8:44am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/15 "2019-06-21T08:44:34Z")

</div>

hmmmm, where is the setting `setup.dashboards.index` ?  
I tried it with filebeat with the following yml file and it works for me:

> #=========================== Filebeat inputs =============================  
> filebeat.inputs:  
> type: log  
> enabled: true  
> paths:  
> /var/log/\*.log
> 
> #============================= Filebeat modules ===============================
> 
> filebeat.config.modules:  
> path: ${path.config}/modules.d/_.yml  
> reload.enabled: false  
> #============================== Kibana =====================================  
> setup.kibana.host: "localhost:5601"  
> setup.dashboards.index: "testbeat-_"  
> #-------------------------- Elasticsearch output ------------------------------  
> output.elasticsearch:  
> hosts: ["localhost:9200"]
> 
> #================================ Processors =====================================  
> processors:  
> add\_host\_metadata: ~  
> add\_cloud\_metadata: ~

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 8:49am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/16 "2019-06-21T08:49:43Z")

</div>

setup.dashboards.index is here in metricbeat.yml

> #============================== Kibana =====================================  
> setup.kibana:  
> host: "192.168.0.88:5601"
> 
> setup.dashboards.index: "systeminfo-\*"

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 9:04am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/17 "2019-06-21T09:04:57Z")

</div>

Try running from the following command from metricbeat server.

> sudo metricbeat setup --dashboards -E 'setup.dashboards.index="systeminfo-\*"'

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 9:11am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/18 "2019-06-21T09:11:21Z")

</div>

wow... it works!!!! 🙂  
you are so great!!  
visualize follow index id : systeminfo-\*

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/7/4764c14da97f6c325e35869dfc3a9348e62ec95d.png)

just 1 error.  
kibana index is also make

as you can see that metricbeat-\* index pattern is made by setup command but that index pattern can't follow anything..

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/1/7/170e5ac69ce3694ef6cbdcdabbdb98d5f5f5e7bc.png)

---

<div class="post-metadata">

**Author:** ![thekm1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thekm1/32/35926_2.png) [@thekm1](https://discuss.elastic.co/u/thekm1)\
**Post date:** [June 21, 2019, 9:13am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/19 "2019-06-21T09:13:07Z")

</div>

Nice =)

Dashboards working as well ?

---

<div class="post-metadata">

**Author:** ![Min\_Mah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/min_mah/32/46757_2.png) [@Min\_Mah](https://discuss.elastic.co/u/Min_Mah)\
**Post date:** [June 21, 2019, 9:16am UTC](https://discuss.elastic.co/t/lifecycle-policy/186795/20 "2019-06-21T09:16:33Z")

</div>

yesss i have to try more.  
when i'm just using only system metricbeat  
it working good!!!!

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/f/4/f45d0b29de4bb8aa02fb644063a4be10b5042363.png)

[Next page](https://discuss.elastic.co/t/lifecycle-policy/186795.md?page=2)
