Have a look at Slow date_histogram after upgrading to 7.3.0 on "dense" indexes.
We experienced exactly the same symptoms as you and could reproduce it with a sample dataset. The query profiler shows that the query phase is fast, but most of the time is spent in the collect phase.