Spark is unable to write to ES when the cluster is in Red state even when the index to which the spark is reading/writing is 100% available, in Green state.
The Spark job just hangs, it doesn't fail or timeout
Is there any setting? Do I need to change? The setting I see is the write will be impacted only when the index to which we are reading/writing is in a red state!
Any help would be appreciated!