inital connection with IRSA following the documentation worked. Later the connection is failing and the authentication is falling back to default method rather than IRSA and hence failing.
Restarting all the ES nodes is making it work again, but this might happen again
ES version 8.15
looks like this issue: Elasticsearch does not refresh AWS Web Identity Token file when changed on disk · Issue #101828 · elastic/elasticsearch · GitHub