We are intermittently getting the below error in elasticsearch logs. It gets this error after some time, it will be back.
elasticsearch version - "6.3.2"
Real concern in the log
- marking and sending shard failed due to [failed to create shard]
- java.io.IOException: failed to obtain in-memory shard lock
- : failed to obtain shard lock
I have gone through the related blogs which is mentioning this.
so where I need help
- Why "shard lock" is happening?
- Is there any data loss when this happens
- How to track why it is happening. Any command or any suggestion on this so that I get more details on this