Filter terms aggregation on array field

To rule out other authors than 1&2, you have to list up all the authors in "must not" clause in boolean query. There is no negation syntax for term level.

Discussion about "How to find docs that contain the eact specified terms" looks related to your purpose. Hopefully it may help you.