Job scheduler for ES?


(Igor Yakushin) #1

Hello,
What does ES do when multiple jobs by multiple users are submitted to ES cluster?
Is it FIFO? Is there any kind of scheduler? Are jobs put on some queue or rejected while the cluster is running some job?
Or do people integrate ES with a traditional scheduler like Slurm and create ES cluster on demand?
Or is ES typically used by a single user?
Thank you,
Igor


(Mark Walkom) #2

What do you mean by "jobs"?


(Igor Yakushin) #3

Hi Mark,
I am coming from a standard HPC environment and not sure that I understand
how elastic search behaves when multiple users are trying to query it.
Can, for example, only one query at a time be executed on ES cluster or
multiple queries can run simultaneously? Are queries queued until they can
run?
Thank you,
Igor


(Mark Walkom) #4

Ahh right.

Elasticsearch is mulitenanted, so if 5 users submit queries then all 5 will run at the same time. There is (currently) no concept of resource allocation/prioritisation and everything runs at the same priority and until they are done.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.