Based on the doc, keystore modification only updated when elasticsearch started, and it's node specific.
This really make using s3-repository plugin and update IAM keys complicated.
Is there any way to add it once and shared across all nodes? and/or update it without restarting nodes?
We restarted master and client nodes after update the keys. Looks like now elasticsearch:9200/_snapshot/repo/ will return snapshots.
But I assume data nodes still need to update keys to correct value in order to make sure snapshot works right? Is there any way to share these keys across nodes?