Merging is triggered by indexing documents (unless explicitly called through the API). If you disabled your indexing then ES will not be performing merges either.
It might be worth looking at the hot_threads output when you experience these problems to help determine what's causing the slow queries.
HTH