Ingest node disc usage keeps rising

[stephenb (Stephen Brown)]

Hi @Tadija Welcome to the community and thanks for trying Elastic Cloud.

Thanks for taking the time to explain your case.

Can you please share your ILM Policy?

@Tadija

I expected it to be much lower since I've setup ILM to move the data immediately.

This is a bit interesting... ILM does not move data "Immediately" it runs in the background periodically. This is often a bit of a misconception. Here is a little more from a previous post.

ILM doesn't work

Hi @vp096 Is your use case really about deleting data 15 mins old, or are you just testing? The reason I ask is ILM is not really design to operate on "Minute" Scheduled or Small KB/MB indices is designed to manage large scale indices GB, Hours, Days etc. and for that it works very well. I posted a bit about it here and another elastician here