Cross inner-hits sort and pagination

From the document, sort and pagination can be done per inner-hits. Is there any way I can sort and paginate across all inner-hits?