What about this:
Assign by just clicking in the team mates that you need to assign the email, and then press escape. no need to confirm, since its already confirmed when its ticked.
Also the keyboard shortcut should be something you can do with one hand like "ctrl+alt+a" for "Assign"