Performance hit due to sort over date field

This looks like to me the index sorted feature.
More on this at: https://www.elastic.co/fr/blog/index-sorting-elasticsearch-6-0

About nested data, I don't see the point. Do you mean that your date field is in nested documents?