It's not best practise to set threadpools like that. ES manages these (to a degree) dynamically and hard setting them like this can cause more problems.
Are you using the noop scheduler? If not I'd try that to start.
Are merges happening at that time?