Writing action logs to a separate log file

I've modified logging.yml to add a separate file for logging action execution:

log action execution errors for easier debugging

action: DEBUG, action_log_file

Unfortunately, the action execution is now getting logged to both the main log as well as the new action log.

Is there a way to have the action execution logged to just the action log file?