How can I create an alert for one-time events?

I want to set up an alert that triggers whenever one of my APIs returns a 500 error. This doesn’t really fit into the usual active/recovered/flapping model since it’s more of a single event rather than something that stays active or recovers.

One idea could be to have the alert automatically create a case for each occurrence—but I’m not sure if that’s a good approach.

How do others typically handle alerts for events where you don’t want them to disappear as “recovered”? Any suggestions?