Ignore hits that have been placed in bucket

I am using the geohash_grid aggregation. I would like to access all documents that were not placed in the aggregation's bucket. Is that possible?

For example, I have some documents containing locations that are relatively close to one-another. When I set geohash_grid's precision to 1, I see all of my documents placed in the same bucket. I would like to see no documents in the hits section of the result now, since they were all placed into the bucket.

Is there a way to achieve this with Elasticsearch?