Elasticsearch aggregation doesn't work with nested-type fields

But now I have a bit more tricky question, involving two nested fields. I now have another field "comment" with exactly the same mapping as "project" - same nested format, same two subfields "name" and "age".

I need to change the query above to compute median on "project.age" but order by "comment.name" or vice versa. The purpose is to get top projects with lowest median comment time. But since both fields are nested and I can only specify one of them in nested aggregation, when I change order field from "project.age" to "comment.age" I don't get anything back.

Do I need to somehow utilize elasticsearch 2.0 sibling aggregations here or there's a simplier soluiton?