Define and tune elastic cluster

Please provide steps involved for the below process

  1. Create an Index Lifecycle Management Policy for retention of 60days
  2. Create an ideal index template taking into consideration the existing cluster size and log ingestion per day.
  3. Define kibana.autocomplete cloud settings if required.
  4. Define ideal cluster size - number of nodes with capacity details for each component E-L-K
  5. Create a snapshot policy for 60 days retention of data.
  6. Review and revive the existing cluster health
  7. Define ideal cluster tuning guidelines - checks to be done for optimum performance.
  8. APM and ML Nodes configuration/receommendation

That is so incredibly broad that it is impossible to answer. You have also not provided any information about your use case or deployment. You generally have a better chance of getting a good response if you ask more targeted questions and show what you have done so far.

Meanwhile I will provide some useful links.

https://www.elastic.co/guide/en/kibana/7.6/index-lifecycle-policies.html

https://www.elastic.co/guide/en/elasticsearch/reference/7.6/index-lifecycle-management.html

https://www.elastic.co/guide/en/elasticsearch/reference/7.6/indices-templates.html

https://www.elastic.co/guide/en/elasticsearch/reference/7.6/tune-for-disk-usage.html

https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud

https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right

https://www.elastic.co/guide/en/kibana/7.6/snapshot-repositories.html

https://www.elastic.co/guide/en/elasticsearch/reference/7.6/snapshot-lifecycle-management-api.html

https://www.elastic.co/guide/en/kibana/7.6/xpack-monitoring.html

https://www.elastic.co/guide/en/elasticsearch/reference/7.6/how-to.html

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.