How to increase queue capacity from 200 to 400?
Which version of Elasticsearch are you using? Which queue do you want to increase? Why do you want to do this?
What is the full output of the cluster stats API?
Have you read this blog post?
This is very old and has been EOL a long time. I would recommend that you upgrade.
Yes I read that post.
About the cluster stats , do you mean the queue_capacity parameter under "enrich".?
No, I would like to see the whole thing.
How many indices and shards are you actively indexing into?
About 900 indices and 1800 shards
Why are you actively indexing into so many indices and shards? It sounds like this may be the problem.
If we assume a bulk size of 1000 documents, which is quite common, it is possible that this will end up sending a very small number of documents to a vary large number of shards, which is inefficient.
I would recommend trying to improve your sharding strategy or segment the data so bulk requests target fewer shards. I do not think increasing the queue capacity will help you much as it does not increase indexing throughput.
What I sent is the total number of indices and shards.
בתאריך יום ב׳, 22 במאי 2023, 22:10, מאת Christian Dahlqvist via Discuss the Elastic Stack <notifications@elastic.discoursemail.com>:
And not the actively indexing statistics.
How many are you actively indexing into?
Look at your indexing pipeline(s)and judge how many index name combinations that may be active at any point in time.
Where can I find this info?
בתאריך יום ג׳, 23 במאי 2023 ב-20:30 מאת Christian Dahlqvist via Discuss the Elastic Stack <notifications@elastic.discoursemail.com>:
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.