hm. I am just speculating here, but this could mean, that the routing parameter is not applied properly?
when you execute a search (one that finds documents) and you add explain: true to it, you can see what shard the document is in, that might help to rule this out.