Easiest way to check which visualizations are unused?

There is an open issue for adding more meta data to saved objects, including last viewed, to make management easier. Please comment on that issue describing your use case.

There is another open issue describing the feature you are request, https://github.com/elastic/kibana/issues/48983. Please comment on that issue as well.