Hello.
Figured it out. A huge number of Spark threads updating the same document with a refresh_interval set to 1sec... This was a misconfiguration where the elasticsearch document_id was supposed to be different. Therefore instead of creating a huge number of different douments in ES, the cluster tried to update only one.