I'm currently upgrading a "cluster" (with a single node) from Elasticsearch 1.x to 6.x. Everything is working out great, but I experience very slow shard allocation on 6.x. I don't remember if I did anything on the old cluster to speed things up. But on a single node cluster, shard allocation should be pretty straightforward.
Is shard allocation slower on 6.x or can I look through some settings on my 1.x node to see what is different?
I have >5,500 shards spread across around 1,800 indices. I totally understand that allocation takes some time with this amount of shards. The only thing I'm wondering about, is the performance difference between the two versions.
Thank you for the link to that blog post. Would love to have seen that earlier I save log data for customers where a customer can have multiple logs (each log can store multiple log messages). Each log is represented by an index consisting of three shards. From what I can see in the article, I should probably have an index per customer, rather than per log per customer.