I am using Amazon ES, can someone tell me what is the ideal way of automatically deleting the old indexes from the cluster considering Amazon ES does not provide the ILM features ?
I have 25 GB of daily index and I want to keep the data for longer period of time for about 6 months. I have read somewhere that data deletion is not a recommended approach as it involves lot of I/O operation. Then what is the way around if I want to maintain small indexes with less data, deleting the old records ?
Also will there be any impact on the memory if the no. of shards increases while I am deleting the documents older than 30 days daily?